Codestral 2501 coding benchmark

How Codestral 2501 performed

Codestral 2501 by Mistral AI took the PomBench AI coding benchmark: every model gets the same prompt and writes self-contained browser code for a twelve-second scene: a Pomeranian runs across a backyard, jumps a puddle, enters its doghouse, retrieves a bone and turns toward the viewer. The video above is an independent offline browser recording of the code Codestral 2501 returned, captured at 960 × 540 and 30 fps, with no organizer edits to the code.

In this Codestral 2501 coding test the model produced 1,440 output tokens, including provider-reported reasoning (rank 43 of 46 by output tokens), and the known API cost was $0.0019 (rank 6 of 45, cheapest first). Is Codestral 2501 good at coding? One task cannot answer that on its own, so this LLM coding benchmark lets you watch the result instead of reading a score: check the gait, the puddle jump and reflection, the doorway occlusion and whether the bone stays in the dog's mouth.

Then compare Codestral 2501 vs Mistral Large 3 and Mistral Medium 3.5 below, or open the AI model comparison to play up to four models on one synchronized timeline.