Workflows
Last updated
Was this helpful?
Last updated
Was this helpful?
A workflow is a configurable automated process made up of one or more job, task, or action call. You must create a YAML file to define your workflow configuration.
There are two kinds of workflows: live and batch.
workflows are executed locally on the developer's machine. They contain a set of job definitions that spawn jobs in the Apolo cloud.
Here's an example of a typical job:
Executing a Jupyter Notebook server in the cloud on a powerful node with a lot of memory and a high-performant GPU.
Opening a browser with a Jupyter web client connected to this server.
workflows serve for orchestration of a set of remote tasks that depend on each other. Batch workflows are executed by the main job that manages workflow graphs by spawning required jobs, waiting for their results, and starting dependent tasks when all of their requirements are satisfied. When possible, operations inside the batch runner will be re-ran on failing to ensure maximum batch stability.