Why this matters
Research planning is inherently open-ended and hard to evaluate automatically because plans lack single gold answers. PaperGym's core insight is to treat each published paper as a complete environment: synthesize the open-ended question from the paper's goal and background, and extract a multi-criterion rubric from the method and experimental design. This decoupling sharply reduces spurious signal (criterion leakage) and lets training optimize against verifiable, atomic criteria rather than a single scalar reward.
Key Findings
- Decoupled data pipeline: a four-stage extraction (Research Goal, Background, Research Method, Experimental Design) enforces that inputs and targets come from disjoint sections, cutting criterion leakage to about 3.7% versus 11.9%–34.1% in prior datasets. This makes rubric-based rewards more trustworthy.
- Rubric-centered two-stage training: first use the rubric as privileged context for a self-distillation teacher to convert sparse criteria into dense token-level guidance; then use the rubric as the reward for GRPO to refine full-plan policies. This schedule outperforms supervised fine-tuning and single-stage variants across model scales.
- Resources and empirical wins: PaperGym-20k (20k instances across CS, physics, economics) plus two held-out benchmarks (PaperGym-Innov and PaperGym-Design). Models trained on PaperGym show consistent gains (e.g., Qwen3-8B reaches 73.48 on ResearchQA) and win more human comparisons than models trained on alternative rubric datasets.
Who it's for — and trade-offs
Great fit if you evaluate or train LLMs/agents that must propose long-horizon scientific plans, design experiments, or optimize methodological novelty; the dataset and rubric format help convert qualitative research goals into verifiable training signals. Look elsewhere if you need turnkey experiment execution (PaperGym focuses on plan generation and evaluation, not running experiments) or if your domain lacks structured papers with separable goal/background and method/design sections. The pipeline depends on clean paper text (LaTeX sources were used) and on reliably extractable structure, so messy or short-form reports may yield weaker rubrics.