AIAny
AI Video2025
Icon for item

ViMax: Agentic Video Generation

Turns a raw idea, novel, or screenplay into a complete multi-shot video through a multi-agent pipeline that scripts, storyboards, and renders shots while a vision model checks character and scene consistency across the whole story.

Introduction

The hard part of AI video was never generating one good clip — it was keeping the same character's face, the same lighting, and a coherent plot across the dozens of clips stitched into minutes of footage. ViMax reframes long-form video as an orchestration problem rather than a single model call, wiring a crew of role-specialized agents (director, screenwriter, producer) around whatever underlying image and video generators you plug in.

What Sets It Apart
  • Four entry points, one pipeline. Idea2Video, Novel2Video, Script2Video, and AutoCameo all funnel into the same scripting → storyboard → shot-generation flow, so you can start from a one-line concept or a finished screenplay and reach the same downstream consistency machinery.
  • A consistency check that actually runs. A multimodal model (MLLM/VLM) inspects generated frames and flags drift in characters and scenes before shots are assembled — the step most DIY text-to-video chains skip, which is why their outputs visibly wander.
  • RAG-grounded screenwriting. Script generation is retrieval-augmented rather than one big prompt, keeping a long story's continuity intact and letting shots be planned and rendered in parallel instead of in one slow chain.
Who It's For

Great fit if you want minutes-long, multi-scene videos — episodic adaptations of a novel, a narrated idea, or cameo clips built from your own photos — and care more about character and scene continuity than per-clip polish. Look elsewhere if you need a single hero shot at maximum fidelity, real-time generation, or a turnkey hosted product: this is a research-grade, self-hosted Python system that orchestrates external generators, so final quality and cost ride on the models you supply.

Information

  • Websitegithub.com
  • OrganizationsData Intelligence Lab @ HKU
  • AuthorsHKUDS
  • Published date2025/03/30

Categories

More Items

GitHub

Generates articulated motion for arbitrary rigged 3D skeletons from text prompts with a single unified model and no per-skeleton retraining. Uses topology-aware diffusion-transformer architecture and a large UniML3D motion dataset to generalize across bipeds, quadrupeds, and other topologies; suitable for text-to-animation workflows and rapid prototyping.

GitHub
AI Video2026
GitHub

Jasna

Detects and restores mosaic-censored regions in videos and images on the GPU while leaving the rest of the frame untouched. Offers a GUI and CLI, two primary restoration models (free BasicVSR++; LTX for NVIDIA supporters), optional secondary upscalers (UNet 4x / RTX Super-Res / Topaz TVAI), and a live preview — requires modern NVIDIA or experimental AMD GPUs.

GitHub
AI Image2026

Build and run node-based AI image and video generation pipelines locally — chain prompts, models, reference images and automations on an infinite canvas. Key differentiators: multi-model pipelines and local-first operation (bring your own kie.ai key), so you keep media and credits under your control.