Summary of the new Valohai features released in 2022. Check the link for additional information on each feature.
Looking to stay up to date with all the new features?
Click on "Follow" on the Patch Notes page to sign up for notifications from the Help Center.
Datasets |
Datasets is a feature in Valohai that makes it easier to work with and track collections of files. You can use them as inputs in your executions, create new versions and aliases and keep track of changes made to the dataset. |
SSH into a job |
SSH into the Valohai job from your local machine. |
Attach a debugger |
How to attach a debugger to a Valohai job in either VSCode or PyCharm. |
Tasks in pipelines |
Tasks inside a pipeline come in handy when you need to run a hyperparameter optimization or parameter sweep as part of a pipeline. |
Organization level environment variables |
You can now set Environment Variable groups to be used by an organization. This helps if several projects are using the same environment variables. |
Saved views |
You can create, save and share your different views based on filters. |
Spot instances with automatic restart |
Run your jobs on cheaper spot instances and automatically restart if your job gets interrupted by the cloud provider. |
Distributed training |
Distributed learning through Tensorflow Distributed, PyTorch Distributed, Horvod, and others is now supported through Valohai tasks. |
Reuse pipeline nodes |
In case of a failed pipeline, you can choose to rerun the pipeline but not rerun the nodes that completed successfully. |
Custom valohai.yaml path |
You can customize the name and path of your valohai.yaml configuration file. Especially nice for monorepository structures! |
Confusion matrix |
Visualize confusion matrixes from your executions metadata. |
Human approval in pipelines |
Pause a pipeline until a human has accepted/declined the pipeline. |
Pipeline conditions |
Set conditions for different stages of a pipeline. |
Estimate CO2 emissions |
Valohai estimates carbon emissions for executions. The carbon emissions are calculated for scope 2 and 3. |
Custom job status |
In addition to a Valohai defined job status (Running, Completed, Error, etc.) you can update your own statuses. |
Manual search in Tasks |
Manual search allows you to add the parameter value combinations aka parameters sets you want to run one by one. |
Hide old commits from the UI |
It is now possible to hide old commits by filtering them out. |
Comments
0 comments
Please sign in to leave a comment.