AIAny
Icon for item

SenseNova Vision Corpus 50M

Provides ~50M multimodal annotations organized for unified training across structured visual understanding, segmentation, dense geometric prediction, and multi-view reconstruction — released as task-specific JSONL files that reference original image assets rather than redistributing raw images.

Introduction

Most public vision corpora are task-siloed and inconsistently annotated, which complicates training unified multimodal models. SenseNova Vision Corpus 50M reorganizes open-source visual data into task-specialized, training-ready supervision across structured perception, segmentation, dense geometry, and multi-view geometry, making it practical to train or evaluate models that need consistent, multi-task visual signals.

What Sets It Apart
  • Unified task families: consolidates 73 dataset-task entries across 10 task types (structured understanding, segmentation, dense geometric prediction, multi-view geometry), so you can assemble multi-task training mixes without manual reformatting.
  • Task-aware curation pipelines: uses pipelines (Rex-Omni adaptations, MoGe-2 densification, LingBot-Depth) to turn sparse or inconsistent annotations into more training-compatible labels — this reduces per-dataset preprocessing overhead.
  • Asset referencing strategy: JSONL annotations keep relative file paths instead of embedding RGB assets, avoiding redistribution issues but requiring users to align a local root with original image sources.
  • Scale and balance: provides tens of millions of frames distributed across complementary task families (e.g., ~18.9M structured, ~17.3M dense-geometry frames), enabling both dense-prediction and high-level multimodal supervision at scale.
Who It's For and Tradeoffs

Great fit if you are training or evaluating multimodal vision models that need consistent supervision across geometry, segmentation, and structured tasks, or if you want to build multi-task curricula without stitching dozens of ad-hoc dataset formats. Look elsewhere if you cannot obtain or reconcile the original image assets (annotations reference file paths, not raw images), if you require a permissive commercial license (dataset uses CC BY-NC 4.0), or if you need datasets exclusively containing proprietary or private image collections. The corpus reduces annotation heterogeneity but shifts effort to dataset rooting and asset alignment.

Information

Categories

More Items

Hugging Face

Evaluates retrievers and search agents on synthetic multi-hop questions that require assembling a complete set of supporting evidence. Provides English and Russian variants (395 questions each), a fixed dense index embedded with Qwen3-Embedding-8B, and BrowseComp-Plus evaluation integrations.

Hugging Face

Provides re-annotated academic video instruction data for captioning, video QA, and fine-grained motion understanding; rewrites short answers and concise captions into evidence-grounded, instruction-following responses and supplies JSONL annotation files (original videos not included).

Hugging Face

Provides 324 Russian short-answer web-search tasks with gold supporting documents to evaluate fixed-index retrievers and search agents. Tasks span eight topical categories and five retrieval challenge types (multihop, structured evidence, temporal, entity disambiguation, comparative) and use a Qwen3-Embedding-8B index for evaluation.