docs(readme): note bounded fire-and-forget writes for provider counters

Re-read the provider/model success-rate paragraph against the FIXED
deadline behavior (v0.22 review round, round 2) per instruction — the
claim itself ("a real deadline counts as a failure") was already
accurate and needed no correction; the multi-wrap bug it was allegedly
describing never surfaced through the README, since the README
describes intended behavior, not the wrap-depth implementation detail
that broke it. Added: FOLDED-1's bound (64 in flight per process,
lossy-under-pressure by design) on the fire-and-forget write this
paragraph already described, and an explicit note that enforcement never
goes through this path.
This commit is contained in:
2026-08-22 00:32:47 +01:00
parent 7eac56cb46
commit 21f51dc282
+6 -1
View File
@@ -592,7 +592,12 @@ http:
[Admin](#admin)) is the only reader; the write itself runs off the [Admin](#admin)) is the only reader; the write itself runs off the
request's own goroutine (fire-and-forget — this is telemetry, and request's own goroutine (fire-and-forget — this is telemetry, and
nothing in the request path waits on or gates against it), so it never nothing in the request path waits on or gates against it), so it never
adds latency to a response, streaming included. adds latency to a response, streaming included. That goroutine is
bounded (64 in flight per process) and lossy under sustained pressure:
a write that cannot start immediately is dropped, not queued — a
deliberate trade-off against an unbounded goroutine pile-up if the
configured store ever goes slow without going fully down. Enforcement
(request/token/cost limits) never goes through this path at all.
- **Native passthrough accounts provider-level only, never per-model.** - **Native passthrough accounts provider-level only, never per-model.**
`POST /{provider}/...` has no resolved model at request time — the `POST /{provider}/...` has no resolved model at request time — the
upstream model, if any, only appears in the response body, read after upstream model, if any, only appears in the response body, read after