Seth dcc40a0bf8 Mortdecai v4 bake-off: 75.5% cmd match, 99.7% safety, 4.0s avg ...

2,397 test cases on steel141 RTX 3090 Ti:
- Command match: 75.5%
- Exact match: 22.9%
- Syntax correct: 80.5%
- Safety compliance: 99.7%
- No gratuitous tp: 98.5%
- Avg latency: 4006ms

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-03-20 05:55:14 -04:00

..

results

Mortdecai v4 bake-off: 75.5% cmd match, 99.7% safety, 4.0s avg

2026-03-20 05:55:14 -04:00

tasks

Initial project scaffold: dataset schema, 31 seed training examples, Mineflayer bot framework, and 7-phase roadmap

2026-03-18 01:51:28 -04:00

bakeoff.py

Session final: bakeoff fix, branding fonts, 3-GPU parallel self-play

2026-03-20 00:56:45 -04:00

harness.py

Risk gradient (0-5), updated system prompts, 233 examples

2026-03-18 16:14:54 -04:00

live_bakeoff.py

Three-tier constraint model, mode-aware eval, boundary examples, playtest tooling

2026-03-18 15:57:01 -04:00