AIAny
AI Infra2025
Icon for item

Zvec

Embeds into an app like SQLite, persisting to a local file with no server or separate process. Combines dense and sparse vectors, full-text search, and scalar filters in one hybrid query; C++ core with Python, Node, Go, Rust, and Dart bindings.

Introduction

Most vector search stacks assume you'll first stand up a separate service — a Milvus deployment, a Qdrant node, a managed cluster — before you can store a single embedding. Zvec rejects that premise: it runs inside your process and persists to a local file the way SQLite does, so the database becomes a library call instead of a network hop. The detail that matters is that this isn't a weekend toy. Its core wraps Proxima, the vector engine Alibaba has run in production for years behind Taobao search, Alipay payments, and Youku.

What Sets It Apart
  • Built on a battle-tested engine rather than a fresh implementation, so retrieval quality and recall behavior come from code already serving billions of queries.
  • Dense vectors, sparse vectors, native full-text search, and scalar filters live in one hybrid query — meaning a single store covers semantic, keyword, and metadata retrieval for RAG without bolting on a separate inverted index.
  • A DiskANN on-disk index keeps datasets larger than RAM queryable, so a laptop or edge device can search corpora that wouldn't fit in memory.
  • Write-ahead logging plus concurrent cross-process reads make it crash-safe and shareable — closer to a real database than an in-memory cache.
Great Fit / Look Elsewhere

Great fit if you're building on-device or single-node RAG, shipping embeddings inside a desktop, mobile, or CLI app, or prototyping retrieval without standing up infrastructure. The same file-backed store works from a server down to a Flutter app. Look elsewhere if you need horizontal sharding across many machines, multi-tenant cluster management, or a hosted control plane — an embedded engine deliberately leaves distributed serving to the heavyweight systems it complements.

Information

  • Websitegithub.com
  • OrganizationsAlibaba Tongyi Lab
  • AuthorsAlibaba
  • Published date2025/12/05

Categories

More Items

Enables RL post-training with million-token prompts under a fixed GPU budget by evaluating shared prompt state without autograd, retaining only minimal model state, and replaying short response branches; instantiated as GRPO and demonstrated on Qwen3.6-27B and GLM-5.2 up to multi-million token execution.

GitHub
AI Infra2026

Defines OpenTelemetry semantic conventions for generative AI telemetry — spans, metrics, and events for GenAI clients, the Model Context Protocol (MCP), and provider-specific integrations. Includes YAML models, human-readable docs, and reference implementations to standardize observability across GenAI deployments.

GitHub
AI Infra2024

Provides a lightweight build platform for HIP and ROCm that supports building ROCm, PyTorch, and JAX from source, multi-architecture nightly releases, and integrated CI/CD and developer tooling for Linux and Windows.