lukaszraczylo/traefik-llmgateway
1
0
Fork 0
mirror of https://github.com/lukaszraczylo/traefik-llmgateway.git synced 2026-10-16 05:37:28 +00:00
Code Issues Packages Projects Releases Wiki Activity

test(integration): enable discovery on the real-upstream provider

Browse Source 
Discovery failures are non-fatal (explicit model keeps resolving
offline), and with discovery on, INTEGRATION_REAL=1 runs serve the
gateway's full live catalog from /v1/models instead of one pinned id.
This commit is contained in:
lukaszraczylo
2026-08-20 23:15:13 +01:00
parent 657480348b
commit 8eb06a4b8b
1 changed files with 7 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
integration/traefik/dynamic.yml.tmpl
+7 -4
View File
@@ -132,10 +132,11 @@ http:
type: openai type: openai
baseUrl: "__INTEGRATION_REAL_BASEURL__" baseUrl: "__INTEGRATION_REAL_BASEURL__"
apiKey: "" apiKey: ""
# Explicit rather than discovered: resolution must not depend # Explicit model AND discovery: the explicit entry keeps
# on this container reaching the real upstream at Traefik # resolution working offline (discovery failures are non-fatal
# startup (offline dev machines, CI with no egress). The # by design - log + retry next interval), while discovery
# actual chat completion call in task 7 still goes out live. # populates /v1/models with the gateway's full live catalog
# when the upstream is reachable (INTEGRATION_REAL=1 runs).
# #
# The provider is deliberately NOT named "uni": the upstream # The provider is deliberately NOT named "uni": the upstream
# gateway's own model ids carry a "uni/" prefix, and a # gateway's own model ids carry a "uni/" prefix, and a
@@ -144,6 +145,8 @@ http:
# non-colliding name the whole slash-bearing id below is a # non-colliding name the whole slash-bearing id below is a
# bare model id and is forwarded verbatim. # bare model id and is forwarded verbatim.
models: ["uni/deepseek-v4-flash-0731"] models: ["uni/deepseek-v4-flash-0731"]
discovery: true
discoveryInterval: "5m"
groups: groups:
eng: eng:
limits: limits: