mirror of
https://github.com/fosrl/docs-v2.git
synced 2026-10-01 10:19:23 +02:00
26 lines
1.7 KiB
Plaintext
26 lines
1.7 KiB
Plaintext
---
|
|
title: "Ollama"
|
|
description: "Point a Custom provider at Ollama on a Pangolin site"
|
|
---
|
|
|
|
[Ollama](https://ollama.com) serves local models with an OpenAI-compatible HTTP API. Create a [Custom](/manage/ai/providers/custom) provider and route to that API so Codex, OpenCode, Open WebUI, and other Chat Completions clients can use models running on a site.
|
|
|
|
Pangolin talks to Ollama at `/v1/chat/completions`. Use that OpenAI-compatible listener, not Ollama's native `/api/chat` path.
|
|
|
|
See [Capabilities](/manage/ai/providers/configuration#capabilities) for the full capability list.
|
|
|
|
[Install a site](/manage/sites/install-site) on the same network as Ollama so Pangolin can reach it over the tunnel. See [Reach a Self-Hosted API](/manage/ai/providers/custom#reach-a-self-hosted-api).
|
|
|
|
## Configure
|
|
|
|
1. Sidebar > **AI Gateway** > **Providers** > **Create**.
|
|
2. Set **Provider Type** to **Custom** and give it a name.
|
|
3. Select **OpenAI Chat Completions**.
|
|
4. Set **Routing Mode** to **Site Targets** if Ollama runs on a site's network. Use **Upstream URL** (`http://<host>:11434`) only when the Pangolin node can reach Ollama directly.
|
|
5. Set **Auth Type** to **No Auth** on a private LAN. Use **Bearer** if you set an Ollama API key.
|
|
6. Allow the exact model ids you plan to call, for example `llama3.2`. See [Model Routing](/manage/ai/providers/model-routing).
|
|
7. Save. On the **Network** tab, add a target: the Ollama host, port `11434`, method HTTP.
|
|
8. Attach the provider to an [AI Gateway resource](/manage/ai/overview).
|
|
|
|
Then point a client at that resource: [Codex](/manage/ai/configure-ai-clients/codex), [OpenCode](/manage/ai/configure-ai-clients/opencode), or [Open WebUI](/manage/ai/configure-ai-clients/open-webui).
|