AIAny
Icon for item

ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition

Recovers editable design files from raster images by growing an editable layer hierarchy via an agentic pipeline that selects and composes modality-specific tools. Introduces graceful verification (accept/prune/retry) to prevent error accumulation and presents the Figma Edit Replay Benchmark (909 files, 14,796 edits) to measure editability across layout, color, and text edits.

Introduction

Design files reconstructed from pixels rarely support real edits: visual fidelity metrics miss whether a recovered file can actually be edited in a real design app. ReDesign reframes raster→design reconstruction as a long-horizon, agentic decomposition problem where specialized tool calls build up a layered representation and lightweight local verification prevents errors from compounding.

Key Findings
  • Agentic decomposition for multi-modal recovery: ReDesign composes specialized modules (text, vector geometry, colors, grouping, layer ordering) in a decision sequence, so outputs target editability rather than only pixel fidelity. This means reconstructed files are structured for downstream edits (e.g., text replacement, recoloring).
  • Graceful verification to contain errors: After each expansion step the system either accepts, prunes, or retries a tool output, which avoids large-scale reruns and reduces cascading mistakes — translating to more reliable long-horizon reconstruction.
  • Figma Edit Replay Benchmark and empirical gains: The paper introduces a benchmark of 909 raw Figma files and 14,796 controlled edit instructions that replay edits on reconstructions; ReDesign achieves top editability on layout, color, and text edits while keeping strong visual fidelity compared to layered-decomposition and serial-tool baselines.
Who It's For and Trade-offs

Great fit if you need recoverable, editable design artifacts from images—product designers, UI/tooling teams, and researchers building AIGC→authoring workflows. Look elsewhere if your priority is only pixel-level reconstruction (single-shot image metrics) or if you require a lightweight on-device solution: ReDesign targets editability and relies on multi-step tool orchestration, which increases pipeline complexity and runtime compared with one-shot methods.

Where It Fits

ReDesign sits between reconstruction pipelines that optimize only visual similarity and end-to-end vectorization heuristics: it prioritizes a structured, edit-ready output and introduces a reproducible benchmark to measure the practical utility of reconstructions in real editing scenarios.

Information

  • Websitearxiv.org
  • AuthorsJooyeol Yun, Jintae Park, Hyesu Lim, Junha Hyung, Hyungjin Chung, Jaegul Choo
  • Published date2026/07/28

More Items

Learns generalizable World Action Models for robotic manipulation by scaling causal egocentric video pretraining and grounding learned dynamics with heterogeneous robot trajectories. Key features: a three-stage curriculum (video pretraining, video-action mid-training with a unified action representation, and target-robot specialization) and a Slow–Fast dual-system for 30 Hz real-time action prediction.

Develops a vision-language foundation model for autonomous driving that unifies 3D BEV perception, visual question answering, and motion planning without changing the pretrained VLM architecture. Key elements include an external BEV perception head for 3D detection and occupancy, a Planning Expert using flow-matching for trajectory prediction, and a staged training recipe combining driving and general VLM data.

Converts posed indoor RGB(-D) video into editable, simulation-ready 3D scene graphs by parsing multi-view evidence into per-object bundles, generating complete object assets from that evidence, and placing them with GizmoAct, a VLM policy that refines 9-DoF poses through closed-loop GUI actions.