OpenWebUI
Overview
OpenWebUI is an extensible, feature-rich, and user-friendly self-hosted web interface for interacting with Large Language Models (LLMs). It is designed to operate entirely independent of AI providers such as OpenAI' ChatGPT or Google Gemini, providing a private and secure environment for your AI interactions. OpenWebUI supports various LLM runners, including vLLM, Ollama and other OpenAI API-compatible tools, making it a versatile solution for deploying and managing language models. With an interface similar to ChatGPT, it offers a familiar and intuitive user experience. For more information about this application, refer to the main OpenWebUI app page.
Installing
OpenWebUI can be installed on Apolo either via the CLI or the Web Console. Below are the detailed instructions for installing OpenWebUI using Apolo CLI.
Install via Apolo CLI
Install via Apolo CLI
Step 1 — Obtain the application configuration file template:
apolo app-template get openwebui > openwebui.yaml
Step 2 — Customize the application parameters. Below is an example configuration file. Note that since this application requires integrations with other apps, you must provide each app's instance-id
. You can get a list of all installed apps and their instance ids by running apolo app list
on your terminal.
# Example of openwebui.yaml
template_name: openwebui
template_version: v25.7.0
input:
ingress_http:
auth: true
embeddings_api:
type: app-instance-ref
instance_id: <instance-id> # example: 2bdb5225-e9f1-4208-a4af-9f7bd21c6d17
path: $.internal_api
llm_chat_api:
type: app-instance-ref
instance_id: <instance-id>
path: $.chat_internal_api
pgvector_user:
type: app-instance-ref
instance_id: <instance-id>
path: '$.postgres_users.users[1]'
displayName: openwebui-demo
preset:
name: cpu-small
openwebui_specific:
env: []
Explanation of configuration parameters:
preset: hardware preset allocated for the app
pgvector_user: Select the credentials for the PostgreSQL database that will be used for both the chat history and the vector embeddings.
embeddings_api: OpenAI Compatible Embeddings API
llm_chat_api: OpenAI Compatible Chat API
ingress_http: enable Apolo authentification
Step 3 — Deploy the application in your Apolo project:
apolo app install -f openwebui.yaml
Monitor the application status using:
apolo app list
To uninstall the application, use:
apolo app uninstall <app-id>
If you want to see logs of the application, use:
apolo app logs <app-id>
For instructions on how to access the application, please refer to the Usage section.
eferences
Last updated
Was this helpful?