feat: LLM accuracy testing framework with 17-test catalog

Framework runs a category/subcategory test catalog against multiple
LLMs through an OpenAI-compatible endpoint. Deterministic evaluators
score each response. Reports render as table, markdown, or JSON.
This commit is contained in:
2026-08-17 01:29:45 +01:00
commit 1d51d4cbbd
68 changed files with 7089 additions and 0 deletions
+12
View File
@@ -0,0 +1,12 @@
# Binaries
/llmtest
/bin/
*.exe
*.test
# Local config (copy config.example.yaml -> config.yaml and edit)
/config.yaml
# OS/editor cruft
.DS_Store
*.swp