AIAny
Icon for item

Prompt Routing Dataset

Provides labeled prompts with full-reference answers (including chain-of-thought and code blocks) and per-example metadata to train edge routing/orchestrator models that decide whether to handle inputs locally or route them to larger models. Includes complexity scores, coding/math flags, routing justifications, and an automated override rule; suited for fine-tuning small models (50M–1.5B) for edge deployment.

Introduction

Most edge orchestrators must answer one question reliably: when can a compact local model safely handle a request, and when must it triage to a larger frontier model? This dataset encodes that decision boundary as structured training signals rather than a single label, letting small routing models learn intermediate features (domain, complexity, task type) before predicting a route.

What Sets It Apart
  • Feature-rich rows: each example pairs a user prompt with a full reference solution that preserves intermediate reasoning and code blocks, plus explicit attributes (complexity_score, primary_domain, coding_task, math_task, requires_reasoning) so a model can learn to predict intermediate features before routing.
  • Operationally focused rule: a deterministic override maps complexity>=3 or coding/math tasks to “big model”, creating a clean operational boundary that reduces frontier-model self-reflection bias and yields consistent routing targets during fine-tuning.
  • Edge-first design: curated to train SLMs (target 50M–1.5B) with a recommended multi-task sequence-generation objective that has demonstrably higher routing accuracy than naive single-token classification.
  • Companion router model: the dataset ships alongside a reference 51M routing model intended as a starting point for deployment experiments.
Who It's For and Trade-offs

Great fit if you are building on-device/orchestrator routing for constrained hardware, training compact routers to triage code/math/complex reasoning away from local models, or evaluating multi-step supervision strategies. Look elsewhere if you need large-scale real-user logs (this dataset is ~1k examples and synthetically seeded) or if you require diverse multilingual coverage—entries are English-focused and generated from seeded corpora, so synthetic biases and limited size are real constraints.

License: MIT. Size and provenance: ~992 training examples, created with seeded generation from larger reasoning and instruction corpora and programmatic overrides to enforce routing policy.

Information

Categories

More Items

Hugging Face

Evaluates retrievers and search agents on synthetic multi-hop questions that require assembling a complete set of supporting evidence. Provides English and Russian variants (395 questions each), a fixed dense index embedded with Qwen3-Embedding-8B, and BrowseComp-Plus evaluation integrations.

Hugging Face

Provides re-annotated academic video instruction data for captioning, video QA, and fine-grained motion understanding; rewrites short answers and concise captions into evidence-grounded, instruction-following responses and supplies JSONL annotation files (original videos not included).

Hugging Face

Provides 324 Russian short-answer web-search tasks with gold supporting documents to evaluate fixed-index retrievers and search agents. Tasks span eight topical categories and five retrieval challenge types (multihop, structured evidence, temporal, entity disambiguation, comparative) and use a Qwen3-Embedding-8B index for evaluation.