mirror of
https://github.com/lukaszraczylo/llm-testbench.git
synced 2026-10-12 00:45:19 +00:00
lukaszraczylo
ace50757e4
Reasoning models burn thousands of completion tokens before the answer. Small per-test caps caused silent truncation and zero scores. The runner now floors max_tokens at the config default (12000). The client parses finish_reason. Reports mark truncated cells and the JSON format carries response text for debugging. A stderr progress reporter prints one line per completed request; --quiet disables it.
14 lines
163 B
Plaintext
14 lines
163 B
Plaintext
# Binaries
|
|
/llmtest
|
|
/bin/
|
|
*.exe
|
|
*.test
|
|
|
|
# Local config (copy config.example.yaml -> config.yaml and edit)
|
|
/config.yaml
|
|
|
|
# OS/editor cruft
|
|
.DS_Store
|
|
*.swp
|
|
.claude/
|