AIAny
Icon for item

SenseNova Vision Corpus 50M

Provides ~50M multimodal annotations organized for unified training across structured visual understanding, segmentation, dense geometric prediction, and multi-view reconstruction — released as task-specific JSONL files that reference original image assets rather than redistributing raw images.

Introduction

Most public vision corpora are task-siloed and inconsistently annotated, which complicates training unified multimodal models. SenseNova Vision Corpus 50M reorganizes open-source visual data into task-specialized, training-ready supervision across structured perception, segmentation, dense geometry, and multi-view geometry, making it practical to train or evaluate models that need consistent, multi-task visual signals.

What Sets It Apart
  • Unified task families: consolidates 73 dataset-task entries across 10 task types (structured understanding, segmentation, dense geometric prediction, multi-view geometry), so you can assemble multi-task training mixes without manual reformatting.
  • Task-aware curation pipelines: uses pipelines (Rex-Omni adaptations, MoGe-2 densification, LingBot-Depth) to turn sparse or inconsistent annotations into more training-compatible labels — this reduces per-dataset preprocessing overhead.
  • Asset referencing strategy: JSONL annotations keep relative file paths instead of embedding RGB assets, avoiding redistribution issues but requiring users to align a local root with original image sources.
  • Scale and balance: provides tens of millions of frames distributed across complementary task families (e.g., ~18.9M structured, ~17.3M dense-geometry frames), enabling both dense-prediction and high-level multimodal supervision at scale.
Who It's For and Tradeoffs

Great fit if you are training or evaluating multimodal vision models that need consistent supervision across geometry, segmentation, and structured tasks, or if you want to build multi-task curricula without stitching dozens of ad-hoc dataset formats. Look elsewhere if you cannot obtain or reconcile the original image assets (annotations reference file paths, not raw images), if you require a permissive commercial license (dataset uses CC BY-NC 4.0), or if you need datasets exclusively containing proprietary or private image collections. The corpus reduces annotation heterogeneity but shifts effort to dataset rooting and asset alignment.

Information

Categories

More Items

Hugging Face

Multimodal real-robot dataset of 28,993 teleoperated bimanual manipulation demonstrations (~300 hours) with synchronized multi-view RGB/tactile videos, 65D robot state/action, 60D fingertip tactile signals, and temporally aligned language segments; intended for imitation, visuomotor and visual‑tactile research, CC BY‑NC 4.0 (non‑commercial).

Hugging Face

Benchmark dataset for bilingual (Chinese/English) visual document image editing with 3,506 examples covering 1,578 text edits and 1,928 table edits. Each example pairs input and target images with editing instructions, region masks, and structured annotations for OCR-level evaluation.

GitHub

Charting engine and interpretation dataset for Zi Wei Dou Shu (Purple Star Astrology): deterministic natal chart algorithm, Four Transformations, pattern rules, and large v3/v4 interpretation datasets. Code MIT and data CC BY 4.0; judgment library and AI backend are closed.