Grounds language-based robot planning in learned skill value functions, selecting actions that are both useful and feasible. PaLM-SayCan reports 84% planning and 74% execution success across 101 real-world instructions.
Turns language commands into executable robot policies that combine perception, control APIs, loops, and geometry libraries. Hierarchical code generation recursively fills in missing functions to support new behaviors without policy retraining.
Builds a roughly 42 cm bipedal robot designed to cost under $400 in parts. Its locomotion policies are trained in MuJoCo and tested on the physical robot, making sim-to-real transfer the central challenge.
Trains PPO motion policies for the Microduck biped in MuJoCo Warp and exports them to ONNX for real-robot deployment. Its sim-to-real approach models small-servo behavior and gear backlash rather than relying on idealized actuators.
Provides SimReady 3D assets for robotics and industrial simulation. The OpenUSD content is prepared for simulation workflows, helping teams assemble environments for physical AI.
Autonomously generates, iteratively debugs, and composes robot control programs into a reusable skill library for discovering and refining manipulation skills across simulation and real robots. Uses a code-as-policy continual learning loop—accumulating validated sensorimotor skills instead of model weights—to tackle long-horizon household and benchmark tasks.
Provides 1,800+ hours of synchronized egocentric multi-view recordings with 3D hand reconstructions, wide‑FOV depth, and hierarchical task/subtask annotations for embodied AI and robot learning. Includes six fisheye views, hand meshes, and per-episode temporal labels across 44k+ episodes.
Generates articulated motion for arbitrary rigged 3D skeletons from text prompts with a single unified model and no per-skeleton retraining. Uses topology-aware diffusion-transformer architecture and a large UniML3D motion dataset to generalize across bipeds, quadrupeds, and other topologies; suitable for text-to-animation workflows and rapid prototyping.
Runs reinforcement-learning policies on a tiny biped robot, enabling behaviors such as walking, self-righting, and picking up objects. Policies are trained in simulation and run locally on the robot.
Integrates a pretrained vision–language model with a BEV perception head and a Planning Expert to provide 3D perception, driving VQA and motion planning for autonomous driving while keeping the base VLM architecture unchanged.
Wraps vision–language–action policies into executable skills that are runtime-validated, executed as bounded low-level action chunks, outcome-verified, and logged as structured trajectories. A fixed skill interface enables swapping or adapting low-level VLA policies and provides component-level supervision for training and optional online adaptation.
Trains a world-action model that predicts future visual states to guide zero-shot robotic manipulation; introduces CoAE, SVP, IDM and KASO to pretrain generative and action components from scratch on manipulation data, scaling up to 30,000 hours and improving zero-shot success.