AIAny
AI Video2026
Icon for item

LTX-Best-Face-ID

Generates short videos that preserve a reference person's identity from a single reference image as a LoRA adapter for LTX-2. Uses overlap reference conditioning with TASS‑RoPE source-phase tagging and an ArcFace identity loss; runs in ComfyUI via BFS Nodes and supports a 4‑panel character‑sheet mode for clothing/body consistency.

Introduction

Most text-to-video models struggle to reliably transfer a specific person's identity into a generated clip. This LoRA tackles that gap by injecting a reference latent into the target sequence with a distinct RoPE "source tag" and training with an ArcFace identity loss — a pragmatic recipe that turns LTX-2 into a dependable reference-to-video identity transfer module.

What Sets It Apart
  • Overlap reference + TASS‑RoPE source-phase: the reference latent shares frame-0 spatial grid (overlap) but is multiplied by a distinct RoPE phase (source_id), so the model cleanly separates "who is the reference" from "who to generate". So what: reduces identity confusion and enables multiple reference sources for multi-subject scenes.

  • ArcFace identity supervision: decoded predictions are encoded with an ArcFace projector during training and pulled toward the reference embedding. So what: enforces perceptual face similarity beyond token conditioning and improves face-level fidelity.

  • Character-sheet continuation checkpoint: trained on 4-panel inputs (face + front/side/back) with a native-resolution requirement. So what: lets the model reproduce clothing and body build consistently, not just facial identity.

  • ComfyUI integration (BFS Nodes) and prompt tooling: includes an LTX Identity Transfer node and a Prompt Enhancer that extracts identity attributes from the reference image. So what: ready-to-run for users of the ComfyUI LTX workflow without ad-hoc graph hacks.

Who it's for and trade-offs

Great fit if you need to generate short, identity-preserving video clips from one or a few reference images and you are running LTX-2 in ComfyUI. The model is most reliable with clean, frontal close-up references (or a 1536×1024 character-sheet for clothing/body). Expect better identity when prompts use the recommended ref_t2v: prefix and describe the person's attributes and actions.

Look elsewhere or adjust expectations if you need large-angle/full-body identity transfer without a character-sheet, want zero "first-frame copy" artifacts, or require guaranteed metric-robust identity scores for tiny/occluded faces. Practical constraints: requires the LTX-2 base model, BFS Nodes dependencies (insightface, Gemma encoder), and careful handling of ref_resize_mode for the character-sheet checkpoint.

Technical note: the optional ArcFace projector is available but had marginal gains in the author's experiments; identity is carried mainly by the overlap reference latent and prompt conditioning.

Information

Categories

More Items

GitHub
AI Video2026

Generative-AI-enabled timeline video editor for macOS that lets creators generate and edit videos and images directly inside the timeline. Includes a local MCP server for agent integrations (Claude/Codex/Cursor); editor is open-source while generative processing is closed-source and subscription-based; macOS 26 on Apple Silicon only.

Hugging Face
AI Video2026

Generates a new camera viewpoint from a reference video: an IC‑LoRA adapter for LTX‑Video 2.3 that re‑renders the same scene from a requested discrete camera angle while preserving subject and content. Trained on synthetic multi‑view data, proof‑of‑concept with limited viewpoint range and best for small, chained angle shifts.

Hugging Face
AI Video2026

Generates minute-scale, temporally coherent dance videos from full music tracks using a hierarchical two-stage approach: global keyframe planning plus local temporal refinement; suitable when long-range musical structure and rhythmic continuity matter.