Valohai has a maximum size of 1 GB for commits. In general, Git is not optimal for large files and we recommend moving them to a data store instead.
Even when your commits above 100 MB, fetching them to Valohai can take some time and cause timeouts. It might be that there are large files or directories in your repository that are not relevant to your Valohai executions but you still want to keep them included in your version control. It is possible to use the
.vhignore file to ignore such items from the repository.
.vhignore works similarly to
.gitignore. Defining The files and directories defined in it will not be uploaded to the worker instance. Valohai will also understand
.gitignore but there are a couple of advantages for using
- You can include the large files and directories in your version control but exclude them from your executions.
- If a file or directory is already being tracked by Git, it is not possible to ignore it with
.vhignoreyou can exclude items that have already been committed to Git.
Example of a
.vhignore file (or
# Ignore Mac system files .DS_store # Ignore my large files large-file-directory/ huge.tar.gz
.vhignoreand folders that contain subdirectories. In order for the directory to be ignored, the subdirecotries have to be specified with their paths or by using a wildcard.
# Use paths large-file-directory/ large-file-directory/subdir # Use wildcard large-file-directory/*
Please sign in to leave a comment.