Back to prompt
Execution transcripts
Every recorded model call for single line minified json, no pretty printing at all [qwen2.5-72b-instruct q4, 2x3090]
Runs
8
Model calls
7
Models
3
Cost to run
$0.0081
One run is not listed here
This prompt was also run against a held-out case: the same problem with the same declared checks, but an input that is not published. Publishing it would let a prompt be written to fit the exact test it is judged on, which is the one thing a test cannot survive. Its result is counted in the totals on the prompt page.
Models used: deepseek-v4-flash, deepseek-v4-pro, gemini-3.5-flash-lite
gemini-3.5-flash-lite11 Aug 2026, 16:27 UTC · 0 calls · $0.001444
gemini-3.5-flash-lite11 Aug 2026, 00:57 UTC · 1 call · $0.001396
deepseek-v4-flashcaptured before the executor existed8 Aug 2026, 13:33 UTC · 1 call · $0.000261
deepseek-v4-procaptured before the executor existed8 Aug 2026, 13:33 UTC · 1 call · $0.001739
gemini-3.5-flash-litecaptured before the executor existed8 Aug 2026, 13:33 UTC · 1 call · $0.001396
deepseek-v4-flashcaptured before the executor existed8 Aug 2026, 13:24 UTC · 1 call · $0.000264
deepseek-v4-procaptured before the executor existed8 Aug 2026, 13:24 UTC · 1 call · $0.001652
gemini-3.5-flash-litecaptured before the executor existed8 Aug 2026, 13:24 UTC · 1 call · $0.001389