ModuleNotFound - How to install additional packages?

Valohai runs all executions inside a Docker container. You'll need to install any missing libraries inside an execution if a library or package doesn't exist in the Docker image you're using.

Missing Python modules

For example, for missing Python modules you'll often see an error like ModuleNotFoundError: No module named 'pandas'. To fix the error you'll need to install pandas in your executions.

You can do this by either

• Edit your valohai.yaml and add for example pip install pandas==1.3.5 in your step's command, before running your python script.
• Add pandas==1.3.5 to your requirements.txt if you're using one

In Jupyter notebooks you can add a new cell at the beginning of your notebook and add !pip install pandas==1.3.5

Other packages

You can also run any apt-get install -y commands in your step.

For example, to install graphviz you'd follow their installation instructions:

• Add apt-get install -y graphviz in your step's command, before running pip install -r requirements.txt and your python script.
• Add graphviz to your requirements.txt

---
- step:
    name: preprocess-dataset
    image: python:3.9
    command:
      - apt-get install packagename -y
      - pip install -r requirements.txt
      - pip install numpy valohai-utils
      - python ./preprocess_dataset.py