pangolin_mirror/docs-v2
1
0
Fork 0
mirror of https://github.com/fosrl/docs-v2.git synced 2026-08-31 11:11:30 +02:00
Code Issues Packages Projects Releases Wiki Activity

add model routing and catalog

Browse Source
This commit is contained in:
miloschwartz
2026-08-20 16:46:27 -04:00
parent b8b04491a1
commit 2ed2b2b079
13 changed files with 219 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

54
self-host/advanced/config-file.mdx
View File

@@ -918,6 +918,60 @@ This section contains the complete reference for all configuration options in `c
</Expandable>
</ResponseField>
### AI Model Catalog
The catalog feeds Known Models pickers, wildcard discovery, provider selection, and usage pricing. See [Model Catalog](/manage/ai/model-catalog) for the JSON format, catalog providers, and how budgets use pricing.
<ResponseField name="ai" type="object">
AI Gateway catalog settings. Omit this block to use the defaults.
<Expandable title="AI">
<ResponseField name="model_catalog" type="object">
Where Pangolin loads the model catalog from, and how often it refreshes.
<Expandable title="Model catalog">
<ResponseField name="upstream_url" type="string" default="https://api.fossorial.io/api/v1/models">
HTTP endpoint that returns catalog JSON. Point this at your own API to serve a custom catalog.
```yaml
ai:
model_catalog:
upstream_url: "https://api.fossorial.io/api/v1/models"
```
</ResponseField>
<ResponseField name="file" type="string">
Path to a local catalog JSON file. When set, this file is the base catalog instead of `upstream_url`.
```yaml
ai:
model_catalog:
file: "config/ai-models.json"
```
</ResponseField>
<ResponseField name="merge_file" type="string">
Path to a local JSON file whose entries are merged into the base catalog. Base entries win on duplicates; the merge file only adds models that are not already present.
```yaml
ai:
model_catalog:
merge_file: "config/ai-models-extra.json"
```
</ResponseField>
<ResponseField name="refresh_interval_min_hours" type="number" default="6">
Lower bound, in hours, for the jittered background refresh interval.
</ResponseField>
<ResponseField name="refresh_interval_max_hours" type="number" default="12">
Upper bound, in hours, for the jittered background refresh interval. Pangolin waits a random duration between min and max so many instances do not hit the upstream at the same moment.
</ResponseField>
</Expandable>
</ResponseField>
</Expandable>
</ResponseField>
## Environment Variables
Some configuration values can be set using environment variables for enhanced security: