AIAny
AI Video2026
Icon for item

LingBot-Video-MoE (30B-A3B)

Generates videos from text and image+text prompts using a 30B Mixture-of-Experts model tuned for embodied intelligence; includes a refiner and structured prompt rewriter, and supports diffusers/SGLang runtimes with multi-GPU inference.

Introduction

Most video models focus on visual fidelity; this release focuses on aligning video synthesis with physical-world reasoning for embodied tasks. That shift matters because downstream robotics, simulation, and multi-step interaction tasks require temporally coherent videos that reflect plausible object dynamics and task completion, not just photorealism.

Key Capabilities
  • MoE scale: a 30B-parameter Mixture-of-Experts backbone plus a refiner, designed to increase capacity while keeping inference throughput tractable for large-video generation scenarios. This design targets higher long-horizon and multi-entity reasoning compared with dense counterparts.
  • Large embodied training signal: trained on a mixture that the authors report as including 70,000+ hours of web-sourced embodied video data, with multi-reward supervision for aesthetics, physical rationality, and task completion — meaning outputs are optimized for plausible interactions, not only appearance.
  • End-to-end inference workflows: provides a structured prompt rewriter (two-stage rewriter + LoRA adapter), auto-negative pruning, and ready scripts for single- and multi-GPU inference across diffusers and SGLang backends, plus FSDP/CP8 sharding options for MoE checkpoints.
  • Benchmarked leadership: reported top ranking on a public RBench leaderboard (as of early July 2026) on metrics combining manipulation, long-horizon reasoning, and embodied scenarios.
Who it's for — and tradeoffs

Great fit if you need research-grade video models that emphasize physical plausibility and task-oriented video generation (robotics simulators, embodied AI research, multimodal agents). The project is released under Apache-2.0 and bundles dense and MoE checkpoints plus rewriter components for production-style inference.

Look elsewhere if you need a tiny, single-GPU consumer model for quick mobile prototyping: MoE inference requires substantial system RAM and multi-GPU or specialized runtimes (SGLang/CP8/FSDP) for practical throughput. Expect engineering effort to set up the two-stage rewriter, LoRA adapters, and grouped-expert runtime for best performance.

Information

  • Websitehuggingface.co
  • AuthorsShuailei Ma, Jiaqi Liao, Xinyang Wang, Jingjing Wang, Chaoran Feng, Zijing Hu, Chong Bao, Zichen Xi, Yuqi Gan, Weisen Wang …
  • Published date2026/07/08

More Items

Turns language commands into executable robot policies that combine perception, control APIs, loops, and geometry libraries. Hierarchical code generation recursively fills in missing functions to support new behaviors without policy retraining.

Learns executable language-conditioned local navigation by pretraining on instruction-conditioned Internet egocentric videos, aligning learned visual dynamics with simulated action labels, then jointly fine-tuning for navigation. Achieves high success rates on short-horizon benchmarks (86.5% OVON, 94.9% HabitatGS-LN) with real-robot validation and released code/data.

Hugging Face
AI Model2026

Generates text conditioned on multimodal inputs (text, image, audio, video) with a 1M-token context window; an open-weights mixture-of-experts model aimed at long-horizon coding and agentic workflows, with NVFP4 checkpoints to reduce memory footprint.