lukaszraczylo/llm-testbench
1
0
Fork 0
mirror of https://github.com/lukaszraczylo/llm-testbench.git synced 2026-10-12 00:45:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
42 Commits 1 Branch 13 Tags
7b791a78e7f050048ede1ad4ff6ce0f31db0e41c
Commit Graph
3 Commits
Author SHA1 Message Date
lukaszraczylo 7b791a78e7 feat(cli): show progress bar with elapsed time and ETA 
A terminal gets a bar that rewrites in place. A piped log gets a line every 25 tests or every minute.
The line shows the error count when a call has failed.
 2026-10-02 01:01:13 +01:00
lukaszraczylo 67d50ce85a feat(cli): self-updating progress counter 
The progress stream now shows a single rewriting "test N of M" line
on a terminal, instead of one detail line per request. A piped stderr
gets a plain line every 25 completions plus the final one.
 2026-08-17 10:27:46 +01:00
lukaszraczylo ace50757e4 fix: floor token budgets and surface truncation, add live progress 
Reasoning models burn thousands of completion tokens before the
answer. Small per-test caps caused silent truncation and zero scores.
The runner now floors max_tokens at the config default (12000). The
client parses finish_reason. Reports mark truncated cells and the
JSON format carries response text for debugging. A stderr progress
reporter prints one line per completed request; --quiet disables it.
 2026-08-17 01:55:14 +01:00