AIAny
Icon for item

ReAct: Synergizing Reasoning and Acting in Language Models

Interleaves chain-of-thought reasoning with tool-using actions in one LLM loop: the model plans, queries a source like Wikipedia, then revises from results. Cuts hallucination versus reasoning-only prompting and beats trained agents on interactive tasks.

Introduction

Chain-of-thought lets a model reason but leaves it trapped in its own head, free to hallucinate facts it never checked. ReAct's move is almost embarrassingly simple: let the model emit a "thought," then an "action," then read the resulting "observation," and repeat. Reasoning decides what to look up; the lookup grounds the next thought. That single feedback loop is the seed under most of today's agent frameworks.

Key Findings
  • On HotpotQA and Fever, interleaving Wikipedia search actions with reasoning sharply reduces the fact-fabrication that plagues pure chain-of-thought, because the model is checking claims instead of inventing them.
  • On ALFWorld and WebShop interactive tasks, ReAct prompting with one or two in-context examples outperforms imitation-learning and reinforcement-learning agents trained on thousands of episodes, by absolute success-rate margins in the tens of points.
  • The reasoning trace is human-readable, so you can watch where the agent went wrong and intervene, rather than debugging an opaque policy.
Who Should Read It

Great fit if you build LLM agents or tool-using systems and want the conceptual blueprint that ReAct-style scaffolding, LangChain, and function-calling loops all descend from. Look elsewhere if you need a turnkey library or production code; this is a 2022 research paper, and the prompting tricks have since been refined and partly absorbed into native tool-calling APIs. Read it for the idea, not the implementation.

Information

  • Websitearxiv.org
  • OrganizationsGoogle Research, Princeton University
  • AuthorsShunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, Yuan Cao
  • Published date2022/10/06

More Items

Embeds an agent's reasoning together with its search query to improve retrieval. Trains a 4B embedding model on synthesized deep-research trajectories, helping preserve intent across multi-step searches.

Trains an 8B model to search, synthesize evidence, and write cited research reports. Its reinforcement-learning rewards use evolving rubrics grounded in retrieved evidence and contrasting model responses.

Trains long-horizon web researchers by combining agentic mid-training, synthetic trajectories, and reinforcement learning. A 30.5B-parameter model activates 3.3B parameters per token and learns to plan, search, and synthesize evidence.