AIAny
Icon for item

Know Before Fix: QA-Driven Repository Knowledge Acquisition for Software Issue Resolution

Acquires repository knowledge via a targeted QA loop before generating patches, decoupling knowledge acquisition from repair. A Questioner and Answerer produce evidence-grounded QA pairs that a Resolver uses to generate fixes; improves Pass@1 on SWE-bench Verified with modest overhead.

Introduction

Why this matters

LLM-based coding agents often fail because they try to patch before they truly understand a repository. This paper shows that explicitly converting implicit knowledge gaps into evidence-grounded QA items before repair reduces factual errors and speeds up knowledge-intensive fixing.

Key Findings
  • Two-stage design: a Questioner formulates targeted knowledge queries and an Answerer autonomously explores the repo to produce evidence-grounded answers; a separate Resolver consumes the QA artifacts to generate patches. This decoupling focuses exploration on actual knowledge gaps rather than blind pre-repair crawling.
  • Empirical gain: on SWE-bench Verified, ACQUIRE raises Pass@1 by up to 4.4 percentage points compared to representative pre-repair baselines while incurring only modest additional time and cost.
  • Practical implication: turning ambiguous repository context into explicit QA records both accelerates downstream repair steps and improves factual reliability of generated fixes.
Who it's for and trade-offs

Great fit if you build or evaluate LLM-driven repair agents that must avoid factually incorrect edits and operate on moderately complex codebases. The approach is especially useful when repository context is large or noisy and when small improvements in correctness justify extra exploration time.

Look elsewhere if low-latency or zero-overhead patching is the primary constraint: QA-driven acquisition adds exploration steps and may scale less efficiently on extremely large or frequently changing repositories unless paired with efficient indexing and caching.

Where it fits

Positions between naive pre-repair crawling and full retrieval-augmented generation: instead of retrieving broad context, ACQUIRE produces concise, evidence-linked QA that directly addresses the agent's uncertainty, making it complementary to RAG pipelines and other context-collection strategies.

Information

  • Websitearxiv.org
  • AuthorsHaotian Lin, Silin Chen, Xiaodong Gu, Yuling Shi, Chengxi Pan, Jiaqi Ge, Mengfan Li, Jianghong Huang, Mengchieh Chuang, Beijun Shen
  • Published date2026/07/13

Categories

More Items

Analyzes adversarial weaknesses of World-Action Models (WAMs) via BadWAM, a framework that crafts visual perturbations to decouple a model’s imagined future from its executed actions. Introduces two attack modes—action-only (disruptive) and imagination-preserving (stealthy)—and shows large drops in closed-loop task success (e.g., 96.5%→43.1%).

Turns fragile, implicit search progress into explicit, persistent, shared state for multi-agent information seeking — externalizes progress as Frontier Task, Evidence Graph, Coverage Map and Failure Memory, and uses pipeline-parallel scheduling plus a middleware harness to avoid repeated failed searches and improve utilization and throughput.

Converts completed on-policy trajectories into natural-language 'hindsight skills' and converts the skill-induced action probability shifts into a dense token-level on-policy distillation signal, jointly optimized with outcome-based RL to improve sample efficiency and long-horizon agent behavior.