AIAny
Icon for item

ai4privacy/pii-masking-300k

Provides 300k annotated multilingual text examples for identifying and masking personally identifiable information (PII) across multiple domains and languages (EN, FR, DE, IT, ES, NL). Intended for training and evaluating token-level PII detection and masking models; includes a DOI for citation.

Introduction

Most redaction and data-protection failures come from mismatches between narrow token-level detectors and varied real-world text. This dataset supplies 300,000 synthetic and curated text examples with span-level PII annotations across six European languages, aiming to reduce that mismatch and give practitioners a single, sizable benchmark for token-level masking workflows.

What Sets It Apart
  • Scope and scale: 300k annotated examples makes it one of the larger public PII masking corpora intended for multilingual model training and evaluation, not only one-off test suites.
  • Multilingual coverage: includes English, French, German, Italian, Spanish, and Dutch — useful when evaluating cross-lingual transfer and multilingual token classifiers.
  • Task-oriented annotations: annotations are provided at the span/token level for masking/redaction tasks, making the dataset directly usable for token-classification and sequence-labeling pipelines.
  • Reproducible citation: dataset has a DOI (10.57967/hf/1995) to ease academic and industry referencing.
Who It's For and Trade-offs

Great fit if you need a large, multilingual training or benchmark set for PII detection/masking, or to measure model robustness across languages and domains. It works well for token-classification models, data-privacy tooling, and pre-/post-processing evaluation in redaction pipelines. Look elsewhere if you need human-verified legal adjudication of what counts as PII (this dataset mixes synthetic and curated examples and does not replace legal review), or if your target language set falls outside the six covered languages.

Where It Fits

Use this dataset to pretrain or fine-tune token-level PII detectors, to evaluate masking strategies in data pipelines, or to stress-test LLM prompt-based redaction via supervised baselines. It complements smaller, hand-curated legal PII corpora and larger general-purpose corpora by providing focused, span-level redaction annotations.

How It Was Built (brief)

Creators aggregated synthetic and curated text samples, annotated spans corresponding to PII categories, and packaged the data in JSON format with metadata and provenance tags. The dataset card lists task tags (token-classification, QA, summarization, etc.) because the corpus can be repurposed for multiple downstream tasks, but its primary value remains token-level masking.

Overall, the dataset is a practical benchmark for teams building automated PII redaction and detection systems — valuable for multilingual evaluation and model comparison, but not a substitute for legal or domain-specific human review.

Information

Categories

More Items

Hugging Face

Multimodal real-robot dataset of 28,993 teleoperated bimanual manipulation demonstrations (~300 hours) with synchronized multi-view RGB/tactile videos, 65D robot state/action, 60D fingertip tactile signals, and temporally aligned language segments; intended for imitation, visuomotor and visual‑tactile research, CC BY‑NC 4.0 (non‑commercial).

Hugging Face

Benchmark dataset for bilingual (Chinese/English) visual document image editing with 3,506 examples covering 1,578 text edits and 1,928 table edits. Each example pairs input and target images with editing instructions, region masks, and structured annotations for OCR-level evaluation.

GitHub

Charting engine and interpretation dataset for Zi Wei Dou Shu (Purple Star Astrology): deterministic natal chart algorithm, Four Transformations, pattern rules, and large v3/v4 interpretation datasets. Code MIT and data CC BY 4.0; judgment library and AI backend are closed.