Deployments

Introduction

• Introduction to deployments
• Debug failing deployments
• Deployment concepts
• Test your deployment endpoints
• Monitor your deployment endpoints
• Read deployment version metadata

Real-time inference

• Deploy a model for online inference
• Deployment prefix in routes

Batch Inference

• Batch inference on images
• Batch inference on CSVs

FAQ

• Why is the endpoints file path defined in valohai.yaml?
• Why am I getting Network Error when testing deployments?
• Do I need to connect to a Git repository before I can create deployments?
• How to launch script from a subfolder in FastAPI deployments?
• How do I install additional packages in a deployment?
• Deployment stuck in deployment pending