AIAny
GitHub

Newton

GPU-accelerated physics simulation engine for robotics and simulation research — built on NVIDIA Warp with MuJoCo Warp backend, offering differentiable simulation, OpenUSD support, and extensions for RL/embodied-AI workflows. ([github.com](https://github.com/newton-physics/newton))

Introduction

Why this matters

Modern robotics and embodied-AI experiments increasingly rely on fast, differentiable, and scalable simulation to iterate policies and learn from large batches of rollouts. Newton is designed to put those capabilities on the GPU stack by extending NVIDIA Warp and integrating MuJoCo Warp, so researchers can run large, GPU-parallel physics workloads and use differentiability where needed. (github.com)

What Sets It Apart
  • GPU-first architecture: Extends Warp’s simulation primitives to maximize on-GPU computation and parallelism, reducing CPU–GPU transfer overheads and enabling many simultaneous environments for RL and system identification. This matters when you want thousands of parallel rollouts or large batch differentiable computations. (github.com)
  • Differentiability and extensibility: Built with differentiable components and user-defined extensibility in mind, so gradient-based optimization (e.g., system identification, differentiable control) is supported rather than an afterthought. (github.com)
  • Integration and ecosystem signals: Uses MuJoCo Warp as a primary backend, supports OpenUSD for scene and asset workflows, and was initiated with contributions from Disney Research, DeepMind, and NVIDIA — positioning it for robotics research pipelines that need reproducible, production-grade simulation. (github.com)
Who It's For — Tradeoffs

Great fit if you are a robotics or RL researcher who needs GPU-parallel, differentiable simulation for training or evaluation at scale. It’s also suitable for simulation researchers who want OpenUSD-compatible scene workflows and extensible physics modules.

Look elsewhere if you need a CPU-only, lightweight physics engine (Newton targets NVIDIA GPUs and CUDA), or if your deployment environment forbids GPU acceleration or requires strict commercial licensing beyond Apache-2.0. macOS runs are CPU-only and some advanced GPU features require recent NVIDIA drivers/CUDA. (github.com)

Where It Fits

Positioned between low-level GPU physics research code and heavyweight commercial simulators: it’s an open-source option for teams that want a GPU-native, research-oriented simulation stack that integrates with modern asset pipelines (OpenUSD) and supports differentiable workflows used in embodied-AI and RL experiments. (github.com)

Information

  • Websitegithub.com
  • AuthorsThe Newton Contributors, Disney Research, Google DeepMind, NVIDIA
  • Published date2025/04/22

Categories

More Items

Turns language commands into executable robot policies that combine perception, control APIs, loops, and geometry libraries. Hierarchical code generation recursively fills in missing functions to support new behaviors without policy retraining.

Learns executable language-conditioned local navigation by pretraining on instruction-conditioned Internet egocentric videos, aligning learned visual dynamics with simulated action labels, then jointly fine-tuning for navigation. Achieves high success rates on short-horizon benchmarks (86.5% OVON, 94.9% HabitatGS-LN) with real-robot validation and released code/data.

Turns a VLM into a robot-coding agent that directly drives a dual-arm robot from three RGB cameras, iteratively writing and fixing small executable perception and control tools from observations and logs; evaluated on 42 RoboDojo tasks.