Passthrough accounting read the model id, the usage figures and the
response size from the upstream response without limits.
- Mint a model counter scope only for ids the provider serves. An
upstream that echoed new ids created unbounded counter keys.
- Drop a reported token or cost figure above a fixed ceiling. One huge
figure locked a user out of every budget for the whole window.
- Bill an echoed unpriced model at the price of the model that passed
the cost-budget gate.
- Cap a body-size prompt estimate at one million tokens.
- Bound the total bytes that concurrent passthrough accounting tees
hold. A tee that cannot reserve room falls back to the estimate.
- Add cache.accountHits. When true, a cache hit charges the cached usage
to the user. The default stays false.
