Run a grid search

It can be daunting to try different hyperparameters one-by-one. Valohai offers a mechanism to do hyperparameter searches using parallel executions and a grid search.

When starting a task, instead of a single value for a single hyperparameter, you get to define multiple values at once. There are various modes to choose from e.g. Single, Multiple, Linear, Logspace and Random.

Create a Task with grid search

Prequisites

• A Valohai project that is connected to a Git-repository.
• At least one Step with parameters defined. Follow our Define Valohai parameters tutorial to create a step with parameters.

Creating the Task

• Open your project on app.valohai.com

• Open the Task tab

• Click Create task

• Select the Step that contains parameters and you want to use for the grid search

• Scroll down to Parameters

• Choose Grid search as the Task type (this is the default)

• Set the values for each parameter

  • Choose the type: Single, Multiple, Linear, Logspace or Random

  • Input the values (for multiple input one value per line)

• Click on Create task

Valohai will launch a set of execution to run a grid search. Each execution will have a unique combination of the parameters, within the ranges you provided.

Valohai manages the queueing of those executions, creating new virtual machines to run the jobs and finally scaling the machines back down, when they’re not needed anymore.

A Task is a collection of related executions. You’ll find all the individual executions on the Executions tab of your project.