Tag
Explore by tags
Tests whether browser agents complete 812 tasks across realistic shopping, forum, development, and content-management sites. Evaluates final outcomes rather than matching a reference sequence of clicks.
Extracts reusable workflows from past task trajectories to guide future web actions. Supports offline demonstrations and online experience, improving long-horizon navigation without manually written routines.
Separates web-agent planning from action execution and trains the planner on plans inferred from successful trajectories. Reports 57.58% success on WebArena-Lite and 81.36% on text-only WebVoyager.
Provides a modular full-stack reinforcement learning stack to train and evaluate long-horizon, multi-turn tool-use LLM agents, including a performant trainer, a Tinker-compatible backend, agent orchestration, and Gymnasium-style environments for task design.
Trains web agents to gather information through longer interaction, using an online RL curriculum that expands rollout horizons. Tests on WebVoyager and WebArena show how exploration can complement longer reasoning before each action.
Provides a reproducible, deduplicated corpus of text extracted from PDFs for LLM pretraining—about 3 trillion tokens from ~475 million documents in 1733 language-script pairs. Includes OCR and text extraction pipelines, per-page language IDs, MinHash deduplication, and is released under ODC‑By 1.0.
Trains long-horizon web researchers by combining agentic mid-training, synthetic trajectories, and reinforcement learning. A 30.5B-parameter model activates 3.3B parameters per token and learns to plan, search, and synthesize evidence.
Multi-agent workbench for long- and short-form fiction, scriptwriting, interactive narrative games and multilingual translation. Offers Studio/CLI/TUI tools that plan, draft, audit and revise chapters while maintaining structured story state, branching forecasts, cover generation and multi-model routing. Suited for authors and teams automating long-horizon narrative workflows.
Benchmarks LLM agents on realistic legal work by packaging lawyer-style assignments with client materials and expert, per-deliverable rubrics. Includes an execution harness to run, score, and compare agents across a large, evolving task set spanning multiple practice areas.
Runs coding and long-running research workflows inside a persistent IPython environment with programmatic subagents and a durable 'Continual Harness' for session-level refinements. Key features include recursive subagents (RLM), executable Python skills, background daemon sessions, and evidence-backed local refinements. Best for reproducible, long-horizon coding, experiments, and evaluation pipelines where auditable agent-driven updates matter.
Maintains a local, durable control-plane state that preserves objectives, typed todos, gates, evidence logs, quotas, and verifiable handoffs for long-running AI agent work. Designed to coordinate multi-day agent loops across Codex, Claude Code, Cursor or custom runners while keeping human judgment, auditability, and safe fallbacks explicit.
Benchmark dataset for evaluating long-horizon coding agents and software-engineering tasks, containing English code and tabular metadata in Parquet format; small scale (<1K examples) for fast prototyping and evaluation.