Open reproductions turn papers into inspectable work

Creators can borrow the same pattern. Attach the prompt, source material, model or instrument settings, edit decisions, and final artifact. The method becomes part of the work without pretending the process was automatic.

Source and observed change

The ICML 2026 Open Reproductions effort connects papers, individual claims, and community reproductions in a shared public trail.

The published overview reports 2,226 papers and 35,908 claims represented in the program.
Reproduction work is organized around claims, making the unit of verification smaller and more useful than a whole-paper verdict.
The public hub lets researchers and builders inspect implementations and results rather than relying on summaries alone.

Mechanism to test

A trustworthy research layer needs claim-level provenance: source, implementation, environment, result, and unresolved variance. The reusable pattern is not a leaderboard. It is an evidence graph that makes disagreement inspectable.

Human decision to expose

Proof packet

Input receipt

Source material, prompt, constraints, and permissions.

Process receipt

Model or instrument settings, versions, and selected branches.

Decision receipt

What the creator edited, rejected, combined, or performed.

Output receipt

Final artifact, export details, and the claim it supports.

05 · Useful contribution

Make the next artifact valuable on its own.

Publish a compact reproduction template that turns one claim into a source-linked test record, then contribute findings back to the public hub.

Next specimen

Studio 2 closes the gap between prompt and performance

Continue →