Dify

Overview

Dify is an open-source development platform for building, managing, and deploying applications powered by large language models (LLMs). To learn more about this application, refer to the Dify documentation page for Apolo Console.

Installing

Here we provide brief description of the application installation using Apolo CLI. See Managing Apps page for generic flow of application installation via CLI.

Step 1 — Obtain the application configuration file template:

apolo app-template get dify -o dify.yaml

Another way is to

Step 2 — Customize the application parameters. Dify requires PostgreSQL for data storage, Apolo Blobs for binary objects store (created implicitly) to begin with. vLLM for and Text Embeddings are also needed but not obligatory to run the application installation.

Below is an example configuration file that deploys a Dify application

# Example of dify.yaml

template_name: dify
template_version: apolo
display_name: my-dify
input:
  api:
    replicas: 1
    preset:
      name: cpu-medium
  worker:
    replicas: 1
    preset:
      name: cpu-medium
  web:
    replicas: 1
    preset:
      name: cpu-small
  external_postgres:
    type: app-instance-ref
    instance_id: ee62be03-7013-4ef0-8ff8-bf261db4c717 # postgres app instance ID
    path: postgres_users/users/0
  external_pgvector:
    type: app-instance-ref
    instance_id: ee62be03-7013-4ef0-8ff8-bf261db4c717 # postgres app instance ID
    path: postgres_users/users/0
  ingress_http:
    auth: false
  proxy:
    preset:
      name: cpu-micro
  redis:
    master_preset:
      name: cpu-medium

Step 3 — Deploy the application in your Apolo project:

apolo app install -f dify.yaml

Monitor the application status using:

apolo app list

To uninstall the application, use:

apolo app uninstall <app-id>

If you want to see logs of the application, use:

apolo app logs <app-id>

For instructions on how to access the application, please refer to the Usage section in web console.

Cleanup

When the application is not needed anymore, you could remove it by clicking the "uninstall" button on the installed app details/status screen.

References

• Apolo CLI Application management commands

• Apolo CLI Application template commands

• Apolo web console Dify application management

• Dify helm chart documentation

• Dify platform documentation

• Dify knowledge concept documentation

• PostgreSQL application management

• Apolo Buckets application

• Text Embeddings application management

• vLLM application management