GPT-5.4 coding benchmark
OpenAI · API model gpt-5.4 · Results published 25 Oct 2026 · Benchmark v4
How GPT-5.4 performed
GPT-5.4 by OpenAI took the PomBench AI coding benchmark: every model gets the same prompt and writes self-contained browser code for a twelve-second scene: a Pomeranian runs across a backyard, jumps a puddle, enters its doghouse, retrieves a bone and turns toward the viewer. The video above is an independent offline browser recording of the code GPT-5.4 returned, captured at 960 × 540 and 30 fps, with no organizer edits to the code.
In this GPT-5.4 coding test the model produced 16,200 output tokens, including provider-reported reasoning (rank 12 of 46 by output tokens), and the known API cost was $0.2714 (rank 37 of 45, cheapest first). Is GPT-5.4 good at coding? One task cannot answer that on its own, so this LLM coding benchmark lets you watch the result instead of reading a score: check the gait, the puddle jump and reflection, the doorway occlusion and whether the bone stays in the dog's mouth.
Then compare GPT-5.4 vs GPT-5.3 Codex and GPT-5.4 Mini below, or open the AI model comparison to play up to four models on one synchronized timeline.
GPT-5.4 vs GPT-5.3 Codex, GPT-5.4 Mini and Gemini 3.1 Pro Preview
- GPT-5.4 vs GPT-5.3 Codex: 16,200 vs 7,038 output tokens; known API cost $0.2714 vs $0.1021. Watch side by side
- GPT-5.4 vs GPT-5.4 Mini: 16,200 vs 4,460 output tokens; known API cost $0.2714 vs $0.0216. Watch side by side
- GPT-5.4 vs Gemini 3.1 Pro Preview: 16,200 vs 1,920 output tokens; known API cost $0.2714 vs $0.0273. Watch side by side
GPT-5.4 code
GPT-5.4 wrote its own native browser animation code from the same prompt as every other model. One execution repair is available for empty, truncated or unexecutable code; the final response is kept, not a best-of selection.