AIAny
Icon for item

AnswerCarefully

Provides manually curated Japanese instruction pairs (questions and safe reference answers) for improving LLM output safety, covering broad harm categories and regionally sensitive cases. Includes English meta-tags and standard splits for benchmarking and fine-tuning.

Introduction

Why this matters Many safety datasets are templatic or generated; AnswerCarefully instead collects realistic, manually written Japanese prompts paired with safe reference replies so models learn culturally appropriate refusal, de-escalation, and safe guidance. That makes it practical for both fine-tuning and evaluating models used by Japanese speakers.

What Sets It Apart
  • Manual, culturally grounded samples: every question–answer pair was authored or curated by human annotators to reflect Japanese social and linguistic nuances, reducing unnatural or unrepresentative examples common in synthetic datasets.
  • Broad, taxonomy-driven coverage: built on the Do-Not-Answer safety taxonomy, it spans many harm categories (e.g., illegal instruction, medical/suicide advice, hate, privacy) and adds regionally sensitive items specific to Japan.
  • Usable as instruction data and benchmark: includes reference answers intended for supervised fine-tuning and separate dev/test splits (v1/v2/v3 details), plus English meta-tags in newer releases to aid cross-language adaptation.
Who It's For and Trade-offs

Great fit if you need a compact, safety-focused instruction dataset to reduce harmful outputs from Japanese LLMs or to benchmark safety behaviors across models. It’s especially useful for teams fine-tuning models for Japan-specific deployments. Look elsewhere if you need very large-scale safety corpora, exhaustive multilingual coverage beyond Japanese/English meta-tags, or raw conversational logs — AnswerCarefully prioritizes curated safety cases over scale.

Where It Fits

Serves as a mid-sized, high-quality safety dataset for LLM fine-tuning and evaluation, complementary to larger synthetic or web-mined safety corpora. Works well alongside general-purpose instruction data when the goal is safer, culturally aligned responses for Japanese users.

Information

  • Websitehuggingface.co
  • OrganizationsLLM-jp (Center for Large Language Model Research and Development, National Institute of Informatics), National Institute of Informatics
  • AuthorsHisami Suzuki, Satoru Katsumata, Takashi Kodama, Tetsuro Takahashi, Kouta Nakayama, Satoshi Sekine
  • Published date2024/04/30

Categories

More Items

Hugging Face

Provides 315,000 pairwise human-preference votes comparing 15 English TTS models over 300 operational prompts, with 4,500 high‑quality audio renders and structured vote/pair/prompt records for training or evaluating preference/reward models. Metadata under CC-BY-4.0; audio use governed by model providers' terms.

Hugging Face

A 10‑billion‑document retrieval benchmark with per‑document 768‑dim unit‑norm dense embeddings and mGTE sparse embeddings, FineWeb text/metadata, and exact top‑1000 MS MARCO ground truth for ~120k queries. Built for large‑scale evaluation of dense/sparse/hybrid retrieval, filtered search, indexing, ANNS algorithms, and embedding compression.

Hugging Face

Provides 4.5 billion TikTok video records with captions, timestamps, music IDs and engagement counts for research; split across 27 zstd-compressed Parquet files (~289 GB) and sampled via TikTok's mobile API; released for research-use only with privacy and ToS caveats.