Back to prompt
Execution transcripts
Every recorded model call for Split the question into claims, then let half of it fail
Runs
5
Model calls
9
Models
3
Cost to run
$0.0113
These calls carry no pass or fail
9 real calls were made starting 8 Aug 2026, 14:28 UTC and cost $0.0113. They were captured before the assertion suites existed, so nothing was checked against a declared expectation. Reading the outputs now and deciding after the fact what they should have been checked against would be choosing the target after seeing where the arrow landed, so no verdict is attached. The outputs are here in full for you to judge yourself.
Models used: deepseek-v4-flash, deepseek-v4-pro, gemini-3.5-flash-lite
deepseek-v4-flashcaptured before the executor existed8 Aug 2026, 14:46 UTC · 1 call · $0.000992
deepseek-v4-procaptured before the executor existed8 Aug 2026, 14:46 UTC · 2 calls · $0.004604
deepseek-v4-flashcaptured before the executor existed8 Aug 2026, 14:28 UTC · 2 calls · $0.000839
deepseek-v4-procaptured before the executor existed8 Aug 2026, 14:28 UTC · 2 calls · $0.003660
gemini-3.5-flash-litecaptured before the executor existed8 Aug 2026, 14:28 UTC · 2 calls · $0.001232