Integrates a pretrained vision–language model with a BEV perception head and a Planning Expert to provide 3D perception, driving VQA and motion planning for autonomous driving while keeping the base VLM architecture unchanged.
Wraps vision–language–action policies into executable skills that are runtime-validated, executed as bounded low-level action chunks, outcome-verified, and logged as structured trajectories. A fixed skill interface enables swapping or adapting low-level VLA policies and provides component-level supervision for training and optional online adaptation.
Trains a world-action model that predicts future visual states to guide zero-shot robotic manipulation; introduces CoAE, SVP, IDM and KASO to pretrain generative and action components from scratch on manipulation data, scaling up to 30,000 hours and improving zero-shot success.
Generates compositional 3D scenes as collections of individual object meshes by conditioning a single-object 3D generative prior on multi-view posed observations. Key features include anchor-aligned canonical frames, multi-view DINOv3 feature lifting with an IBR-style fusion, and LoRA adaptation to complete heavily occluded objects; includes a large UE-MeshyScene benchmark.
Trains end-to-end driving without human trajectory supervision by decoupling perception and action: DriveVFM distills multiple frozen vision foundation models into a single camera backbone, and DriveRL trains a privileged closed-loop RL teacher whose rollouts supervise a camera-only planner, yielding state-of-the-art closed-loop benchmark results.
Trains LVLMs to improve 3D spatial reasoning using a synthetic block-stacking dataset of 15,000 problems that cover 3D→2D projection, viewpoint transforms, and structural combination; includes color-anchored cues and provides code and data.
Lets vision-language models control robots via a compact semantic action interface that maps intent to discrete action units; supports zero-shot use of closed-source VLMs, low-cost fine-tuning of open VLMs, and GUI-based demonstration collection.