sendnrw/netbird
2
0
Fork 0
mirror of https://github.com/netbirdio/netbird.git synced 2026-07-22 16:31:28 +02:00
Code Issues Packages Projects Releases Wiki Activity

Add Kimi (Moonshot AI) provider to Agent Network catalog

Browse Source 
Adds a first-class kimi_api catalog entry so operators can govern Kimi K3
and K2 Thinking traffic through the Agent Network proxy instead of riding
the generic custom/vllm entry.

ParserID is left empty so the proxy's URL sniffer dispatches both body
shapes Moonshot serves on the same host and key: the OpenAI-compatible
/v1/chat/completions endpoint and the Anthropic-compatible
/anthropic/v1/messages endpoint that Moonshot's official Claude Code
setup uses (same pattern as the Bifrost gateway entry).

Pricing defaults cover both parser surfaces, including the kimi-k3[1m]
model id some Claude Code guides use for the 1M-context alias, so cost
metering doesn't silently skip those requests.

The dashboard's PROVIDER_CATALOG needs a matching entry (separate repo).
This commit is contained in:
mlsmaycon
2026-07-21 04:04:01 +00:00
parent 51f17bf919
commit 4e44210c16
2 changed files with 69 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

30
proxy/internal/llm/pricing/defaults_pricing.yaml
View File

@@ -161,6 +161,18 @@ openai:
input_per_1k: 0.0001
output_per_1k: 0
# Kimi / Moonshot AI (kimi_api) — OpenAI-compatible /v1 endpoint. Moonshot
# reports cache hits OpenAI-style when present; cached input is 10% of
# input for K3 ($0.30 vs $3.00 per MTok) and $0.15/MTok for K2 Thinking.
kimi-k3:
input_per_1k: 0.003
output_per_1k: 0.015
cached_input_per_1k: 0.0003
kimi-k2-thinking:
input_per_1k: 0.0006
output_per_1k: 0.0025
cached_input_per_1k: 0.00015
anthropic:
# Claude 4.x family — cache reads ≈10% of input, cache writes ≈125% of input.
# Pricing source: Anthropic's current published rates per million tokens,
@@ -206,6 +218,24 @@ anthropic:
cache_read_per_1k: 0.0001
cache_creation_per_1k: 0.00125
# Kimi / Moonshot AI (kimi_api) via the Anthropic-compatible endpoint
# (/anthropic/v1/messages — the official Claude Code setup). Same rates
# as the OpenAI-shape entries above. "kimi-k3[1m]" is the model id some
# Claude Code guides set for the 1M-context alias; priced identically so
# cost metering doesn't silently skip those requests.
kimi-k3:
input_per_1k: 0.003
output_per_1k: 0.015
cache_read_per_1k: 0.0003
"kimi-k3[1m]":
input_per_1k: 0.003
output_per_1k: 0.015
cache_read_per_1k: 0.0003
kimi-k2-thinking:
input_per_1k: 0.0006
output_per_1k: 0.0025
cache_read_per_1k: 0.00015
bedrock:
# AWS Bedrock model ids, normalised by the request parser (cross-region
# inference-profile prefix + version/throughput suffix stripped), e.g.