About BroadBox

A benchmark should let an AI scientist do science.

BroadBox brings scientific agents into controlled environments where they can form hypotheses, choose experiments, learn from real feedback, and revise what they believe.

How we came together

We came to BroadBox from different parts of the same problem. Arya's work on scientific sandboxes described controlled environments where an AI agent could decide what to test and learn from the result—not simply answer a static question.

At the same time, our work in laboratory automation made a second possibility tangible: those environments could connect directly to experiments. An agent could propose a hypothesis, request a measurement, receive evidence from the lab, and decide what to do next.

We realized that these ideas belonged together. BroadBox defines a new way to benchmark AI scientists for the era of autoscience: by measuring how well they investigate, adapt, and discover when reality is in the loop.

01

Ask a real question

Each sandbox begins with a scientific objective rather than a benchmark answer key.

02

Let the agent investigate

Agents choose experiments, document their reasoning, and revise their hypotheses.

03

Score against reality

Experimental results—not fluency—determine how well the scientific process worked.

The paper

Scientific sandboxes for AI agents.

The sandbox paper describes environments in which agents can propose experiments, receive feedback from a sealed oracle, and improve their hypotheses over successive rounds. BroadBox turns that idea into a shared platform for real scientific competitions.

Paper link coming soon

People

Organizing team

Researchers working across scientific agents, experimental design, and laboratory automation.

Arya Rao

Arya Rao

Yasha Ektefaie

Yasha Ektefaie

B

Bryan

Portrait placeholder

Jackson Weir

Jackson Weir

Sandeep Kambhampati

Sandeep Kambhampati

Shantanu Singh

Shantanu Singh