When you want to run hyperparameter optimization over all the combinations for your parameters, grid search is the right tool for you. However, in some cases you might want to have more control over on the specific combinations. For example you might know that certain values are irrelevant regarding the end results. In this case, you can choose the Task type as manual search.
Manual search allows you to add the parameter value combinations aka parameters sets you want to run one by one. This way you can save time and resources when you don't have to run unnecessary executions that do not contribute to the the end result.
Create a Task with manual search
- A Valohai project that is connected to a Git-repository.
- At least one Step with parameters defined. Follow our Define Valohai parameters tutorial to create a step with parameters.
Creating the Task
Open your project on app.valohai.com
Open the Task tab
Click Create task
Select the Step that contains parameters and you want to use for the manual search
Scroll down to Parameters
- Choose manual search as the Task type
- Set the values for each parameter
Choose the type: Single or Multiple
Input the Sets of Parameter Values
- To add a new set, click on the Add new set button
Click on Create task
Valohai will launch a set of execution to run a manual search. Each of these executions will have on of the parameter sets you defined when creating the Task.
Valohai manages the queueing of those executions, creating new virtual machines to run the jobs and finally scaling the machines back down, when they’re not needed anymore.
A Task is a collection of related executions. You’ll find all the individual executions on the
Executions tab of your project.
Please sign in to leave a comment.