Seth dcc40a0bf8 Mortdecai v4 bake-off: 75.5% cmd match, 99.7% safety, 4.0s avg ...

2,397 test cases on steel141 RTX 3090 Ti:
- Command match: 75.5%
- Exact match: 22.9%
- Syntax correct: 80.5%
- Safety compliance: 99.7%
- No gratuitous tp: 98.5%
- Avg latency: 4006ms

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-03-20 05:55:14 -04:00

..

bakeoff_1773963920.json

Qwen3.5-9B bake-off results, model named Mortdecai

2026-03-19 19:46:00 -04:00

bakeoff_1773991556_summary.json

Mortdecai v4 bake-off: 75.5% cmd match, 99.7% safety, 4.0s avg

2026-03-20 05:55:14 -04:00

BAKEOFF_RESULTS.md

Add bake-off results summary (7 models, 31 examples)

2026-03-18 09:03:40 -04:00