AIAny
Icon for item

EmbodiedSkills: A Unified Framework for Orchestrating, Training, and Deploying VLA Agents

Wraps vision–language–action policies into executable skills that are runtime-validated, executed as bounded low-level action chunks, outcome-verified, and logged as structured trajectories. A fixed skill interface enables swapping or adapting low-level VLA policies and provides component-level supervision for training and optional online adaptation.

Introduction

Most vision–language–action (VLA) models predict actions but don’t by themselves make reliable long-horizon agents. The core insight behind this work is to treat each high-level skill choice as an execution proposal that must pass runtime preflight checks and post-execution verification, transforming black-box action generation into a traceable, trainable closed-loop agent layer.

Key Findings
  • Modular skill interface: skills have typed inputs/outputs and explicit prerequisites, so the runtime can block invalid invocations before physical actions occur — this reduces silent failures and makes trajectories interpretable for supervision.
  • Strong cross-benchmark execution: task-adapted low-level VLA policies in the paper achieve 86.20% average success over 50 RoboTwin 2.0 tasks and 97.40% across four LIBERO suites, demonstrating robust short-horizon execution when integrated into the agent loop.
  • Trajectory-driven training: the system records multimodal context, runtime errors, and verifier outputs so planners, low-level policies, and verifiers can be trained or adapted independently using subtask-level supervision or optional online feedback.
  • Clear limits revealed: the same execution approach yields only 12.5% average success on memory-dependent RMBench tasks, highlighting that skill orchestration improves deployment reliability but does not alone solve long-term memory or complex reasoning deficits.
Who It's For and Trade-offs

Great fit if you need to convert VLA models into inspectable, deployable embodied systems where runtime safety checks, outcome verification, and per-component training matter. It’s especially useful when you want to swap or fine-tune low-level execution policies without changing orchestration logic. Look elsewhere if your primary bottleneck is long-term memory, complex multi-step reasoning beyond short-horizon execution chunks, or when you require end-to-end learned policies with no modular runtime checks.

Where It Fits

EmbodiedSkills sits between high-level planners and robot controllers: it does not replace low-level VLA action models but wraps them with pre-execution validation, bounded execution windows, post-execution verifiers, and structured logging so that embodied agents become safer, debuggable, and easier to train component-wise.

Information

  • Websitearxiv.org
  • OrganizationsAffiliation: College of Computer Science and Technology, Zhejiang University, Affiliation: Nanjing University of Aeronautics and Astronautics, Affiliation: Cornell University, Affiliation: Universal Ubiquitous AI Co., Ltd., Affiliation: Hangzhou DEEP Robotics Technology Co., Ltd., Affiliation: National University of Singapore
  • AuthorsWei Wang, Wenqiao Zhang, Yutong Lin, Yuqian Yuan, Tianwei Lin, Jinhao Mao, Zhenxuan Fan, Mingjian Gao, Yang Dai, Wentong Li …
  • Published date2026/09/01

More Items

Rewinds world-model trajectories to test alternative robot actions and turn outcome comparisons into action-level training signals. Real-robot data continually corrects the model; across three physical tasks, success rates beat the strongest baseline by 10.67–11.85 percentage points.

Coordinates world creation, trajectory exploration, and Harness evolution to improve multimodal agents. It organizes tasks by shared capabilities rather than surface categories, reporting mean gains of 34 points on training benchmarks and 26 on unseen benchmarks.

Conditions robot action generation on predicted visual and motion features, capturing physical dynamics without generating future video during control. Reports results across four simulation benchmarks.