Apolo
HomeConsoleGitHub
  • Apolo concepts
  • CLI Reference
  • Examples/Use Cases
  • Flow CLI
  • Actions Reference
  • Apolo Extras CLI
  • Python SDK
  • Getting started
    • Introduction
    • First Steps
      • Getting Started
      • Training Your First Model
      • Running Your Code
    • Apolo Base Docker image
    • FAQ
    • Troubleshooting
    • References
  • Apolo Console
    • Getting started
      • Sign Up, Login
      • Organizations
      • Clusters
      • Projects
    • Apps
      • Pre-installed apps
        • Files
        • Buckets
        • Disks
        • Images
        • Secrets
        • Jobs
          • Remote Debugging with PyCharm Professional
          • Remote Debugging with VS Code
        • Flows
      • Available apps
        • Terminal
        • LLM Inference
          • vLLM Inference details
          • Multi-GPU Benchmarks Report
        • PostgreSQL
        • Text Embeddings Inference
        • Jupyter Notebook
        • Jupyter Lab
        • VS Code
        • PyCharm Community Edition
        • ML Flow
        • Apolo Deploy
        • Dify
        • Weaviate
        • Fooocus
        • Stable Diffusion
  • Apolo CLI
    • Installing CLI
    • Apps
      • Files
      • Jobs
      • Images
  • Administration
    • Cluster Management
      • Creating a Cluster
      • Managing Users and Quotas
      • Managing organizations
      • Creating Node Pools
      • Managing Presets
Powered by GitBook
On this page
  • Introduction
  • Cluster configuration YAML

Was this helpful?

  1. Administration
  2. Cluster Management

Creating a Cluster

PreviousCluster ManagementNextManaging Users and Quotas

Last updated 2 months ago

Was this helpful?

Introduction

Apolo lets you create a cluster in any of the three major cloud providers - , , and . After you sign up with a cloud provider, you have to share your service account information and the configuration you need with our team. We will then set up a cluster on your behalf, and install Apolo on your cloud for you.

To set up a Apolo cluster, you have to do the following:

  1. Set up a cloud environment:

    • GCP: and a .

    • AWS: and a .

    • Azure: and a .

  2. Prepare a cluster configuration YAML file.

  3. Share the configuration YAML file with us. Once we receive the YAML file, we will set up and run the cluster (usually completed within one business day). You can start while it is being set up.

Apart from the process mentioned above, there are other methods of setup:

  • Set up Apolo on an existing cluster provided by AWS, GCP, or Azure. This requires the configuration of the node pool.

  • Set up Apolo on an existing cluster provided by other cloud service providers.

  • Set up Apolo on-premise (or “bare metal”).

For any of these other methods of setup, please .

Cluster configuration YAML

You must create a project/VPC/resource group and a service account with all required permissions before you can start preparing a cluster configuration YAML file. The YAML file is used by the Apolo team to set up and run the cluster. You should use the apolo admin generate-cluster-config command to generate the YAML file. It is an interactive tool that generates a valid configuration file with the default node configuration based on your responses.

The command prompts for the following information in order to generate the configuration file:

Prompt

Description

Cluster Type

Enter cloud service provider - AWS, GCP, Azure

GCP Project Name or AWS VPC ID or Azure subscription ID

  • For GCP, enter the name of the project.

  • For AWS, enter the VPC ID you created in the previous step.

  • For Azure, enter the Azure subscription ID you created in the previous step.

Service Account Key File (.json)

Or

AWS Profile Name

Or Azure information

  • For Azure, enter the following access information:

    • Azure Files storage size (GB)

Below is a sample command for GCP:

> apolo admin generate-cluster-config
Select cluster type (aws, gcp, azure): gcp
GCP project name: My Project
Service Account Key File (.json): GCP_User.json
Cluster config cluster.yml is generated.

The command creates the cluster.yml file that includes the information required by the Apolo team to set up your cluster. Here is a sample cluster.yml generated for a new GCP cluster:

type: gcp
location_type: multi_zonal
region: us-central1
zones:
- us-central1-a
- us-central1-c
project: My Project
credentials:
 auth_provider_x509_cert_url: https://www.googleapis.com/oauth2/v1/certs
 auth_uri: https://accounts.google.com/o/oauth2/auth
 client_email: johndoe@intricate-web-236410.iam.gserviceaccount.com
 client_id: '105087309181394151560'
 client_x509_cert_url: https://www.googleapis.com/robot/v1/metadata/x509/johndoe%40intricate-web-236410.iam.gserviceaccount.com
 private_key: ...
 private_key_id: ...
 project_id: intricate-web-236410
 token_uri: https://oauth2.googleapis.com/token
 type: service_account
node_pools:
- id: n1_highmem_8
 min_size: 1
 max_size: 4
- id: n1_highmem_8_1x_nvidia_tesla_k80
 min_size: 1
 max_size: 4
- id: n1_highmem_8_1x_nvidia_tesla_v100
 min_size: 0
 max_size: 1
storage:
 id: standard
 capacity_tb: 4

The file contains a default nodes pools configuration that is used as a starting point:

  • 1 non-preemptive node with K80

  • 1 non-preemptive node with V100

  • 4 non-preemptive non-GPU nodes

  • and 4 Tb of standard storage

The file will create a cluster with the following presets:

  • cpu-small,

  • cpu-large,

  • gpu-small (a node with K80), and

  • gpu-large (a node with V100).

To get information about available options for each of the cloud providers, run:

apolo admin show-cluster-options .

apolo admin add-cluster <path/to/config>

Once we receive the YAML file, we will set up and run the cluster (usually completed within one business day). After the command is run, you become the admin of the cluster. You can start adding users to the cluster as soon as you run the command above.

For GCP, enter the path to the service account key file. For information on service accounts, see .

For AWS, enter the profile name in AWS. For more information, see .

You can further update the cluster.yml file as per your requirements before you send it to us. If you have any issues updating the file, then . Once you are done updating the configuration file, you should send the cluster.yml file to the Apolo team for the cluster setup using the command:

Amazon Web Services
Google Cloud Platform
Azure
Create a project
service account
Create a VPC
service account
Create a resource group
service account
adding your users to the cluster
contact our team
contact us
Understanding service accounts
Managing Access Keys
Azure client ID
Azure tenant ID
Azure client secret
Azure resource group