Apolo
HomeConsoleGitHub
  • Apolo concepts
  • CLI Reference
  • Examples/Use Cases
  • Flow CLI
  • Actions Reference
  • Apolo Extras CLI
  • Python SDK
  • Getting started
    • Introduction
    • First Steps
      • Getting Started
      • Training Your First Model
      • Running Your Code
    • Apolo Base Docker image
    • FAQ
    • Troubleshooting
    • References
  • Apolo Console
    • Getting started
      • Sign Up, Login
      • Organizations
      • Clusters
      • Projects
    • Apps
      • Pre-installed apps
        • Files
        • Buckets
        • Disks
        • Images
        • Secrets
        • Jobs
          • Remote Debugging with PyCharm Professional
          • Remote Debugging with VS Code
        • Flows
      • Available apps
        • Terminal
        • LLM Inference
          • vLLM Inference details
          • Multi-GPU Benchmarks Report
        • PostgreSQL
        • Text Embeddings Inference
        • Jupyter
        • VSCode
        • PyCharm Community Edition
        • MLflow
        • Apolo Deploy
        • Dify
        • Weaviate
        • Fooocus
        • Stable Diffusion
        • Hugging Face
        • Service Deployment
        • Spark Application
  • Apolo CLI
    • Installing CLI
    • Apps
      • Files
      • Jobs
      • Images
      • Available apps
        • VSCode
        • Hugging Face
        • Service Deployment
  • Administration
    • Apolo Credits
    • Cluster Management
      • Creating a Cluster
      • Managing Users and Quotas
      • Managing organizations
      • Creating Node Pools
      • Managing Presets
Powered by GitBook
On this page
  • Overview
  • Deployment on Apolo
  • Usage
  • References

Was this helpful?

  1. Apolo Console
  2. Apps
  3. Available apps

Hugging Face

PreviousStable DiffusionNextService Deployment

Last updated 5 days ago

Was this helpful?

The Hugging Face App on Apolo enables efficient management of Hugging Face model and dataset caches within Apolo's infrastructure. This integration ensures that large binary files are preserved in Apolo storage, facilitating seamless access and management. Future enhancements will include linking Hugging Face Hub user access tokens to bind accounts with caches, allowing authorized access to private models and datasets, as well as providing in-depth introspection of models, datasets, suggestions for inference and much more.

Overview

The Hugging Face App provides the following functionalities:

  • Manage cached models and datasets within Apolo's storage.

  • Connect caches to inference models to preserve large binary files.

  • (Upcoming) Link Hugging Face Hub user access tokens for authorized access.

  • (Upcoming) Repositories introspection.

Deployment on Apolo

Web Console UI

  1. Navigate to the Apolo Console: Access the Apolo Console and go to the "Apps" section.

  2. Select "Hugging Face Cache" App: Choose the "Hugging Face Cache" application from the list of available apps.

  1. Configure storage:

  • Files Path: Select or type path on Apolo storage where assets will be preserved.

  1. Set application name Variables.

  1. Click "install".

Now you can use this cache to speedup load times of datasets or models from Hugging Face Hub.

Usage

You could see the list of supportable applications in the description of this app (related applications).

The use of this app is mostly transparent for the user.

References

Hugging Face Cache Management
Hugging Face Hub Caching Guide
Apolo LLM Inference Documentation
Apolo Hugging Face management via CLI
Hugging Face Cache application