PomBench

GPT-5.4 Mini coding benchmark

OpenAI · API model gpt-5.4-mini · Results published 25 Oct 2026 · Benchmark v4

Compare GPT-5.4 Mini vs GPT-5.4 Nano ↗

How GPT-5.4 Mini performed

GPT-5.4 Mini by OpenAI took the PomBench AI coding benchmark: every model gets the same prompt and writes self-contained browser code for a twelve-second scene: a Pomeranian runs across a backyard, jumps a puddle, enters its doghouse, retrieves a bone and turns toward the viewer. The video above is an independent offline browser recording of the code GPT-5.4 Mini returned, captured at 960 × 540 and 30 fps, with no organizer edits to the code.

In this GPT-5.4 Mini coding test the model produced 4,460 output tokens, including provider-reported reasoning (rank 33 of 46 by output tokens), and the known API cost was $0.0216 (rank 15 of 45, cheapest first). Is GPT-5.4 Mini good at coding? One task cannot answer that on its own, so this LLM coding benchmark lets you watch the result instead of reading a score: check the gait, the puddle jump and reflection, the doorway occlusion and whether the bone stays in the dog's mouth.

Then compare GPT-5.4 Mini vs GPT-5.4 Nano and GPT-5.4 below, or open the AI model comparison to play up to four models on one synchronized timeline.

GPT-5.4 Mini vs GPT-5.4 Nano, GPT-5.4 and Gemini 3.1 Pro Preview

GPT-5.4 Mini code

GPT-5.4 Mini wrote its own native browser animation code from the same prompt as every other model. One execution repair is available for empty, truncated or unexecutable code; the final response is kept, not a best-of selection.

Read the shared prompt · How the LLM benchmark works

Latest models tested