AIAny
AI Audio2024
Icon for item

Voice-Pro

Local WebUI for video and audio dubbing: download YouTube, isolate vocals, transcribe with Whisper, translate into 100+ languages, and generate multilingual TTS or zero-shot voice clones. Uses Gradio, yt-dlp, Demucs, Whisper/Faster-Whisper, F5/E2/CosyVoice and Edge-TTS; Windows-focused with optional Azure integration.

Introduction

Most content creators still stitch multiple tools to turn a foreign-language video into localized subtitles and a dubbed track. This project bundles that pipeline into a single local WebUI so you can download a YouTube video, separate vocals, run ASR, translate subtitles, and synthesize a dubbed track without juggling separate CLIs and manual format conversions.

What Sets It Apart
  • Unified, local workflow: integrates yt-dlp, Demucs (vocal isolation), Whisper/Faster-Whisper (ASR), Deep-Translator (100+ languages) and multiple TTS/voice-cloning backends so users work in one Web interface instead of many disconnected tools — so what? faster iteration and fewer format/encoding hassles when producing subtitles and dubbed audio.
  • Zero-shot voice cloning + multiple TTS providers: supports F5-TTS, E2-TTS, CosyVoice (including Fun-CosyVoice3) and Edge-TTS, with optional Azure keys for higher-quality/enterprise endpoints — so what? you can produce voice-matched dubs across many languages without training custom models.
  • Practical, reproducible installer: uses uv lockfiles and portable dependencies (auto-downloads ffmpeg, bundled Python runtime, prebuilt wheels) so installs are fast and reproducible on Windows machines without requiring CUDA toolkit or Visual Studio — so what? reduces setup friction for creators on restricted or corporate PCs.
  • Open-source, Windows-first design with GPU acceleration: optimized for NVIDIA GPUs (works on CPU/GPU), exposes denoise/compute-type controls and subtitle formats (SRT/ASS) for downstream editing.
Who it fits / trade-offs

Great fit if you need an all-in-one, locally run dubbing/subtitle pipeline for podcasts, YouTube content, or multilingual video localization and you prefer an offlineable toolchain. Look elsewhere if you need a hosted SaaS with guaranteed SLAs, a cross-platform polished Mac/Linux UX (the project is Windows-focused and best-tested on NVIDIA GPUs), or if legal/ethical constraints forbid the use of celebrity voice samples — the repo includes many reference voices and relies on user responsibility for voice consent.

Information

  • Websitegithub.com
  • OrganizationsABUS, WeConnect
  • AuthorsABUS
  • Published date2024/07/29

Categories

More Items

GitHub
AI Audio2026

Zero-shot text-to-speech across 600+ languages with short-reference voice cloning and attribute-based voice design. Uses a diffusion-style discrete non-autoregressive architecture mapping text to multi-codebook acoustic tokens, supports phoneme/pinyin control and very low RTF.

GitHub
AI Audio2025

Provides text-to-speech synthesis and one-shot voice cloning via compact ONNX models and a larger KittenTTS 2 speech model. Offers CPU-first inference (25–506 MB models), 47 built-in voices, multilingual output, expression tags, streaming, and a Python SDK.

Hugging Face
AI Audio2026

Generates directed, multi-character, long-form speech from text with natural-language directions and voice cloning. Built on a 35B MoE backbone (3B active per token) with a codebook multi-token-prediction decoder to enable multi-turn revision, infilling edits, streaming, and expressive control.