Commit Graph

Select branches

Hide Pull Requests

main

#1

#2

#3

#4

v0.2.10

v0.2.3

v0.2.5

v0.2.7

v0.2.9

v0.4.3

v0.4.5

v0.5.1

v0.6.1

v0.8.1

v0.8.11

v0.8.3

v0.8.9

Mono Color

• 768f1a4d66 chore(deps): update dependencies main v0.8.11 github-actions[bot]andGitHub 2026-10-10 03:24:37 +00:00
• 9c7d385317 chore(deps): update go toolchain directive to v1.27.1 v0.8.9 github-actions[bot]andGitHub 2026-10-04 04:21:24 +00:00
• 3aa2d4ce57 ci(deps): update dependencies with Renovate [skip ci] lukaszraczylo 2026-10-03 18:44:48 +01:00
• 5177cc6daa Update go.mod and go.sum (#2) 3 people 2026-10-03 11:08:18 +00:00
• dfb9fcc370 ci: migrate release to shared workflows and add PR and autoupdate (#1) v0.8.3 lukaszraczyloandGitHub 2026-10-02 04:41:55 +01:00
• 1310c5bebe feat(llm): make runs resilient and reproducible on slow backends v0.8.1 lukaszraczylo 2026-10-02 01:01:14 +01:00
• 7b791a78e7 feat(cli): show progress bar with elapsed time and ETA lukaszraczylo 2026-10-02 01:01:13 +01:00
• 6934d4df84 fix(eval): bound exec evaluators and pin their environment lukaszraczylo 2026-10-02 01:01:00 +01:00
• cfdb2c5aae feat: function-calling (MCP-style) tests plus ultra-hard tasks v0.6.1 lukaszraczylo 2026-08-30 20:22:20 +01:00
• 708622e2a8 feat(tests): add 16 advanced distractor-rich scenarios v0.5.1 lukaszraczylo 2026-08-30 19:41:02 +01:00
• 6ad9dfbe42 fix(runner): record wall-clock latency on error rows v0.4.5 lukaszraczylo 2026-08-30 16:19:21 +01:00
• 7616f4bdee fix(llm): retry 429 responses and 2xx bodies carrying an error object v0.4.3 lukaszraczylo 2026-08-30 14:19:35 +01:00
• d9b7ca9cc4 feat(config): raise max_tokens_default to 40000 lukaszraczylo 2026-08-30 14:19:22 +01:00
• 499956f8cc fix(tests): disambiguate two prompts, exempt --force-if-includes lukaszraczylo 2026-08-30 14:19:08 +01:00
• 6b0bea1193 fix(eval): remove four negation-detector false-positive classes lukaszraczylo 2026-08-30 14:18:53 +01:00
• cde7c7ce14 Update v0.2.10 lukaszraczylo 2026-08-30 12:37:38 +01:00
• 5eef0482de ci: pin third-party actions to commit SHAs, add concurrency and timeout v0.2.9 lukaszraczylo 2026-08-17 21:45:18 +01:00
• 5f8db06d32 ci: bump workflow actions to current major versions v0.2.7 lukaszraczylo 2026-08-17 21:44:40 +01:00
• eabbea5508 fix(tests): pull the docker base image before layer inspection v0.2.5 lukaszraczylo 2026-08-17 10:55:48 +01:00
• 28aeb63dd8 ci: add goreleaser and semver-driven release workflow v0.2.3 lukaszraczylo 2026-08-17 10:49:35 +01:00
• 67d50ce85a feat(cli): self-updating progress counter lukaszraczylo 2026-08-17 10:27:46 +01:00
• 8a1d9717bb chore: add Makefile with build, test, lint, check, run targets lukaszraczylo 2026-08-17 09:59:56 +01:00
• 7c2d968fd2 docs: record first full 3-model benchmark run lukaszraczylo 2026-08-17 05:08:50 +01:00
• 9d1d4d89e9 fix(catalog): unify negation guard and harden round-2 evaluators lukaszraczylo 2026-08-17 03:50:57 +01:00
• 9e5deda646 test(catalog): wire databases, security, delivery, and ai categories lukaszraczylo 2026-08-17 02:48:45 +01:00
• 9ae41bd493 Merge branch 'worktree-agent-a7e0f11d7f73fdb33' lukaszraczylo 2026-08-17 02:48:09 +01:00
• fcf39df06e Merge branch 'worktree-agent-a1c953a49697bd583' lukaszraczylo 2026-08-17 02:48:08 +01:00
• 0c01046c4b Merge branch 'worktree-agent-a0b0f5406dcb45aa0' lukaszraczylo 2026-08-17 02:48:08 +01:00
• b44acc0e49 Merge branch 'worktree-agent-a728bb06345ae9b79' lukaszraczylo 2026-08-17 02:48:08 +01:00
• 7264fe81b7 fix(catalog): harden evaluators against correct-answer phrasing variance lukaszraczylo 2026-08-17 02:48:05 +01:00
• e455eeecc7 test(catalog): add delivery category with 30 tests lukaszraczylo 2026-08-17 02:28:01 +01:00
• d778bb6c17 test(catalog): add security category with 30 tests lukaszraczylo 2026-08-17 02:23:46 +01:00
• 0665d706f0 test(catalog): add databases category with 30 tests lukaszraczylo 2026-08-17 02:20:34 +01:00
• d4b3d4601f test(catalog): add ai category with 30 tests lukaszraczylo 2026-08-17 02:16:57 +01:00
• 8ab83a57ca docs: add round-2 expansion spec for four new categories lukaszraczylo 2026-08-17 02:03:44 +01:00
• 8318d01f11 test(catalog): assert at least 10 tests per subcategory lukaszraczylo 2026-08-17 01:58:04 +01:00
• 586700758f fix(eval): accept multiplier-suffix numbers like 64x lukaszraczylo 2026-08-17 01:57:58 +01:00
• 1b29019325 Merge branch 'worktree-agent-a752fbca389ae50df' lukaszraczylo 2026-08-17 01:55:49 +01:00
• 21ddaf2fc4 Merge branch 'worktree-agent-a975228ccb1ce06d4' lukaszraczylo 2026-08-17 01:55:48 +01:00
• 8b70503f87 Merge branch 'worktree-agent-a51a5d5173d0ab0f0' lukaszraczylo 2026-08-17 01:55:48 +01:00
• 3e3e0d4f01 Merge branch 'worktree-agent-af28b622ee23b5cef' lukaszraczylo 2026-08-17 01:55:48 +01:00
• ace50757e4 fix: floor token budgets and surface truncation, add live progress lukaszraczylo 2026-08-17 01:55:14 +01:00
• 0816dd6186 test(catalog): expand programming to 10 tests per subcategory lukaszraczylo 2026-08-17 01:54:39 +01:00
• e7479e9169 test(catalog): expand research to 10 tests per subcategory lukaszraczylo 2026-08-17 01:51:11 +01:00
• 3f9fed6f02 test(catalog): expand operations to 10 tests per subcategory lukaszraczylo 2026-08-17 01:48:15 +01:00
• 053eeab1bb test(catalog): expand agents to 10 tests per subcategory lukaszraczylo 2026-08-17 01:47:36 +01:00
• 764fe990fd docs: add expansion spec for 10 tests per subcategory lukaszraczylo 2026-08-17 01:32:06 +01:00
• 1d51d4cbbd feat: LLM accuracy testing framework with 17-test catalog lukaszraczylo 2026-08-17 01:29:45 +01:00