AIAny
Icon for item

Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environments

Reconstructs executable terminal workspaces from recorded agent trajectories and synthesizes verifiable single- and multi-round coding tasks for agent training; it replays file operations, uses an LLM completion agent to fill missing files/dependencies, and verifies tasks with autogenerated test suites.

Introduction

Most training for terminal-based coding agents lacks realistic, re-executable environments: trajectories are frozen demonstrations without the underlying workspace needed to re-run or verify solutions. Terminal-Universe flips that problem by recovering the latent workspace from a trajectory's tool-execution history, completing missing context with a completion agent, and turning each recovered environment into many testable tasks and multi-round sessions.

Key Findings
  • Reconstruct-by-replay: Replays chronological read/write/edit operations to restore the earliest-observed file states, producing a partial workspace that reveals the environment structure so many missing pieces can be inferred rather than invented—this preserves real-world grounding.
  • LLM-based completion + verification: Uses a completion agent to fill missing files/dependencies and an agentic verifier to author pytest suites; only tasks whose solutions pass these automated tests are kept, yielding high-quality SFT data.
  • Scale and diversity: Applied to public terminal trajectories, the pipeline produced 37.3k task-sufficient environments and 31.9k verified SFT demonstrations, and fine-tuning Qwen3.5-27B on this corpus increased single-round Terminal-Bench 2.1 by 11.9 points and multi-round EvoCode-Bench v2 MT@4 by 13.8 points.
  • Breadth & depth expansions: Mines directional cross-workspace dependencies to synthesize multi-repo queries (breadth) and converts single-turn traces into multi-round sessions that simulate iterative user feedback (depth), better matching developer workflows.
Who it's for and tradeoffs

Great fit if you need scalable, execution-grounded training data for code/terminal agents and want verifiable SFT examples derived from real agent behavior. It helps teams that train or evaluate coding tutors, autonomous dev agents, or retrieval-augmented code solvers. Look elsewhere if your trajectories lack sufficient file-access traces (reconstruction fails), if strict provenance/IP is required (completion agents may introduce synthesized content), or when you need fully human-curated environments rather than LLM-completed ones. The approach trades fully manual environment curation for scalable, LLM-assisted reconstruction that can hallucinate absent details and depends on the quality of recorded traces.

Information

  • Websitearxiv.org
  • OrganizationsQwen Team, Alibaba Group, Tsinghua University, Project leader, Corresponding authors
  • AuthorsJie Wu, Zhenru Zhang, Beichen Zhang, Xuwu Wang, Yuhui Su, Mouxiang Chen, Peng Wang, Zhihai Wang, Que Shen, Hao Zhou
  • Published date2026/09/03

Categories

More Items

Defines the Discovery Certification Protocol (DCP) to audit claims of discovery by AI research agents, converting claims into executable recovery and feedback tests. Specifies multi-gate certification, Core control requirements, and a deterministic offline verifier; validated in two controlled audits.

Evaluates whether AI agents can autonomously use Sparse Autoencoders (SAEs) to discover interpretable features and causally steer model behavior. Introduces a 20-task benchmark that has agents design contrastive probes to search a 131K+ feature dictionary in Gemma-2-9B-IT and evaluates activation rank, selectivity, and causal steering against expert references.

Translates natural-language instructions into executable programs that maintain an explicit, persistent global world state and compiles state-augmented 3D oriented bounding boxes into pixel-aligned conditioning signals for pretrained video generators. The approach decouples state evolution from rendering, enabling programmable entity control, off-screen state, and long-horizon interactive scenarios.