Run a manual search

When you want to run hyperparameter optimization over all the combinations for your parameters, grid search is the right tool for you. However, in some cases you might want to have more control over on the specific combinations. For example you might know that certain values are irrelevant regarding the end results. In this case, you can choose the Task type as manual search. 

Manual search allows you to add the parameter value combinations aka parameters sets you want to run one by one. This way you can save time and resources when you don't have to run unnecessary executions that do not contribute to the the end result.

Create a Task with manual search

Prequisites

• A Valohai project that is connected to a Git-repository.
• At least one Step with parameters defined. Follow our Define Valohai parameters tutorial to create a step with parameters.

Creating the Task

• Open your project on app.valohai.com

• Open the Task tab

• Click Create task

• Select the Step that contains parameters and you want to use for the manual search

• Scroll down to Parameters

• Choose manual search as the Task type

• Set the values for each parameter

  • Choose the type: Single or Multiple

  • Input the Sets of Parameter Values

  • To add a new set, click on the Add new set button

• Click on Create task

Valohai will launch a set of execution to run a manual search. Each of these executions will have on of the parameter sets you defined when creating the Task. 

Valohai manages the queueing of those executions, creating new virtual machines to run the jobs and finally scaling the machines back down, when they’re not needed anymore.

A Task is a collection of related executions. You’ll find all the individual executions on the Executions tab of your project.