Perpetual Research

ShadowBench explorer

A model sees a plate from a nineteenth-century book of hand shadows and poses two articulated 3D hands between a lamp and a screen, one tool call at a time, until their shadow matches the animal. Six models at three reasoning efforts on twenty plates make 360 episodes, and no model solved a plate.

Leaderboard

Mean score over the 20 plates, where 100 is a shadow identical to its target, with its 95% bootstrap interval. The dashed lines are references: . Cost is the token cost of one episode.

Every final shadow

Each tile is a final shadow laid over its target: shadow on the target, target the shadow misses, shadow outside the target. The blob is the convex hull of the target. Plates are ordered from easiest to hardest; select a tile to replay its episode.

Episodes

The image the model received
All calls