Datasets | Mozilla Data Collective

MirasAICompensated

🚧 Noakhali 10 Hours TTS (Male Speaker) 🚧

A high-quality Noakhali TTS dataset with paired speech recordings and text transcriptions for speech synthesis, linguistic research, and language preservation.

License: MirasAI Data License

Locale: oak

Task: TTS

Format: WAV, TSV

Size: 2.87 GB

Institute of African Digital Humanities

A Bamvele Sociocultural Dataset

Sociocultural dataset for the Bamvele community of Cameroon: identity, kinship, religion, economy, onomastics and a linguistic component.

License: NOODL-1.0

Locale: beb

Task: OTH

Format: TSV, PDF

Size: 357.17 KB

Institute of African Digital Humanities

A Bulu Sociocultural Dataset

Sociocultural dataset for the Bulu community of Cameroon: identity, kinship, religion, economy, onomastics and a linguistic component.

License: NOODL-1.0

Locale: bum

Task: OTH

Format: TSV, PDF

Size: 372.87 KB

Institute of African Digital Humanities

A Ngemba Sociocultural Dataset

Sociocultural dataset for the Ngemba community of Cameroon: identity, kinship, religion, economy, onomastics and a linguistic component.

License: NOODL-1.0

Locale: nge

Task: OTH

Format: TSV, PDF

Size: 401.87 KB

PROXIMA

Pakistan HSSC-I Mathematics Dataset

Instruction-following dataset of Pakistan HSSC-I (Grade 11) mathematics problems in Parquet format for educational AI, NLP, question answering, and research.

License: CC-BY-NC-SA-4.0

Locale: en

Task: LLM

Format: PARQUET

Size: 105.73 KB

PROXIMA

Urdu-Sindhi Grapheme-to-Phoneme Dataset

A bilingual Urdu and Sindhi grapheme-to-phoneme dataset for G2P, TTS, ASR, and speech technology research.

License: CC-BY-NC-SA-4.0

Locale: ur, sd

Task: TTS

Format: PARQUET

Size: 1.92 MB

Community

Advanced Geometrical Optics and Magnetism Problems and Solutions

Advanced physics problems with detailed solutions covering geometrical optics, mirrors, lenses, refraction, dispersion, and magnetism.

License: APDL-1.0

Locale: en

Task: LLM

Format: JSONL

Size: 3.08 MB

PROXIMA

PII Redact Urdu UOPF

Curated Urdu dataset of 100,000 records with fabricated PII spans, for training and evaluating privacy span detection across 12 domains.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLP

Format: JSONL

Size: 5.77 MB

Community

SKAD Ladino Speech Database (subset)

Spoken Ladino (Judeo-Spanish) from native speakers in Istanbul, recorded and transcribed by SKAD, re-packaged for ASR training and evaluation.

License: CC-BY-NC-SA-4.0

Locale: lad

Task: ASR

Format: WAV, TXT

Size: 4.99 GB

MDC DatasetsCompensated

🚧 Hazargi Multimodal Dataset 🚧

A Hazargi multimodal dataset with 10 hours of synchronized video, audio, transcriptions, speech segmentation, and ELAN annotations.

License: MDC DLA-1.0

Locale: haz

Task: NLP

Format: MP4, EAF

Size: 44.00 GB

Institute of African Digital Humanities

An Ewondo Sociocultural Dataset

Sociocultural dataset for the Ewondo community of Cameroon: identity, kinship, religion, economy, onomastics and a linguistic component.

License: NOODL-1.0

Locale: ewo

Task: OTH

Format: TSV, PDF

Size: 355.75 KB

Institute of African Digital Humanities

An Eton Sociocultural Dataset

Sociocultural dataset for the Eton community of Cameroon: identity, kinship, religion, economy, onomastics and a linguistic component.

License: NOODL-1.0

Locale: eto

Task: OTH

Format: TSV, PDF

Size: 367.19 KB

Institute of African Digital Humanities

A Ghomala Sociocultural Dataset

Sociocultural dataset for the Ghomala community of Cameroon: identity, kinship, religion, economy, onomastics and a linguistic component.

License: NOODL-1.0

Locale: bbj

Task: OTH

Format: TSV, PDF

Size: 346.33 KB

Institute of African Digital Humanities

A Chadian Arabic Sociocultural Dataset

Sociocultural dataset for the Chadian Arabic community of Cameroon: identity, kinship, religion, economy, onomastics and a linguistic component.

License: NOODL-1.0

Locale: shu

Task: OTH

Format: TSV, PDF

Size: 357.46 KB

PROXIMA

Sindhi Transliteration Dataset by Proxima AI

Sindhi transliteration dataset containing Sindhi sentences paired with Roman Sindhi transliterations for NLP research and model development.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: CSV

Size: 5.09 MB

Taruen

Chechen Proverbs and Sayings Text Corpus

A corpus of traditional Chechen proverbs and sayings digitized from a 1990 collection, designed for NLP tasks and LLM cultural competence evaluations.

License: CC0-1.0

Locale: ce

Task: NLP

Format: TXT

Size: 12.38 KB

Taruen

Bulgarian Proverbs and Sayings Text Corpus

A corpus of traditional Bulgarian proverbs and sayings digitized from a 1986 compilation, designed for NLP tasks and LLM cultural competence evaluations.

License: CC0-1.0

Locale: bg

Task: NLP

Format: TXT, TSV

Size: 132.39 KB

PROXIMA

Urdu Grammatical Error Correction Dataset

Paired Urdu dataset containing 600,000 incorrect correct sentence pairs for training grammatical and spelling error correction models.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLP

Format: Parquet

Size: 107.99 MB

PROXIMA

Urdu AI Generated Quotes & Aphorisms

A collection of 3,317 AI-generated Urdu quotes and aphorisms for text-generation and language modeling research.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLG

Format: JSON

Size: 174.90 KB

PROXIMA

Urdu OCR Multi Source Dataset (Proxima AI)

Urdu OCR dataset of 40,769 image text pairs compiled from scanned, printed, synthetic, and scene text sources.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: CV

Format: PARQUET

Size: 436.48 MB

MDC Curators

CoVoST 2 Swedish - English

The dataset includes audio files in Swedish and their translations in English.

License: CC-BY-NC-4.0

Locale: sv-SE, en

Task: MT

Format: MP3, TSV

Size: 112.38 MB

AImpower.org

English Stuttered Speech

The dataset include 39 hours of transcribed and annotated conversational and voice command reading speech from 45 English speakers who stutter.

License: CC-BY-SA-4.0

Locale: en

Task: ASR

Format: WAV, TXT

Size: 9.75 GB

AImpower.org

Mandarin Stuttered Speech (StammerTalk)

The StammerTalk dataset contains 43 hours of spontenous conversations and reading of voice commands by 66 Mandarin Chinese speakers who stutter.

License: CC-BY-NC-SA-4.0

Locale: cn

Task: ASR

Format: WAV, TXT

Size: 4.61 GB

Sewá Morales

Ralámuli Ra’icháala TTS

Aproximadamente 2 horas con 20 minutos de habla leída de la lengua ralámuli, de una sola hablante.

License: CC-BY-NC-4.0

Locale: tar

Task: TTS

Format: WAV, TSV

Size: 422.68 MB

All Datasets

Compensated datasets

Conversational Speech in Gujarati in the Finance Domain

Conversational Speech in Manipuri in the Finance Domain

Conversational Speech in Manipuri in the Medical Domain

🚧 Noakhali 10 Hours TTS (Male Speaker) 🚧

A Bamvele Sociocultural Dataset

A Bulu Sociocultural Dataset

A Ngemba Sociocultural Dataset

Pakistan HSSC-I Mathematics Dataset

Urdu-Sindhi Grapheme-to-Phoneme Dataset

Advanced Geometrical Optics and Magnetism Problems and Solutions

PII Redact Urdu UOPF

SKAD Ladino Speech Database (subset)

🚧 Hazargi Multimodal Dataset 🚧

An Ewondo Sociocultural Dataset

An Eton Sociocultural Dataset

A Ghomala Sociocultural Dataset

A Chadian Arabic Sociocultural Dataset

Sindhi Transliteration Dataset by Proxima AI

Chechen Proverbs and Sayings Text Corpus

Bulgarian Proverbs and Sayings Text Corpus

Urdu Grammatical Error Correction Dataset

Urdu AI Generated Quotes & Aphorisms

Urdu OCR Multi Source Dataset (Proxima AI)

CoVoST 2 Swedish - English

English Stuttered Speech

Mandarin Stuttered Speech (StammerTalk)

Ralámuli Ra’icháala TTS