How can I check what is included in the commit I fetched to Valohai?

You fetched your code to valohai but you are not quite sure what's included? In short, Valohai clones the latest commit from your branch and packages it up. Before packaging, we remove any files ruled out by .vhignore and the .git folder.

To run your trainings and other executions cleanly you should separate data from the code. Valohai will show you a helpful warning if the package's size grows over 100 MB and it won't accept any commits that would end up being larger than 1 GB when packaged.

Here are some tips what you can do if your commit package exceeds the 1 GB limit:

• Check if you have mixed data with your code. You can use inputs to download any data files required in your executions.
• If you are wondering what's included in your package, go to Repository tab under your project Settings.  There you will have another tab called Manage commits and from there you can open the latest commit. Finally, you can use the Download button to get the commit package in order to inspect its contents.
• If you want to get estimation locally you can use following commands
  • First go to an empty folder and run the following commands:
    

    git clone git@github.com:<repository_name> --depth 1 --branch <branch-name>
    rm -rf <repository_name>/.git
    # manually remove any files you have specified in your .vhignore
    tar -zcf package.tgz <repository_name>
    du -h package.tgz

  • The final output should give you an estimation on the size. To get even more precise size you can run stat package.tgz.