Valohai has a maximum size of 1 GB for commits. In general, Git is not optimal for large files and we recommend moving them to a data store instead.
Even when your commits above 100 MB, fetching them to Valohai can take some time and cause timeouts. It might be that there are large files or directories in your repository that are not relevant to your Valohai executions but you still want to keep them included in your version control. It is possible to use the .vhignore
file to ignore such items from the repository.
.vhignore
works similarly to .gitignore
. Defining The files and directories defined in it will not be uploaded to the worker instance. Valohai will also understand .gitignore
but there are a couple of advantages for using .vhignore
:
- You can include the large files and directories in your version control but exclude them from your executions.
- If a file or directory is already being tracked by Git, it is not possible to ignore it with
.gitignore
. With.vhignore
you can exclude items that have already been committed to Git.
Example of a .vhignore
file (or .gitignore
):
# Ignore Mac system files
.DS_store
# Ignore my large files
large-file-directory/
huge.tar.gz
.vhignore
and folders that contain subdirectories. In order for the directory to be ignored, the subdirecotries have to be specified with their paths or by using a wildcard.
# Use paths
large-file-directory/
large-file-directory/subdir
# Use wildcard
large-file-directory/*
Comments
0 comments
Please sign in to leave a comment.