CoVoST 2 English - Japanese

Description

This dataset contains 320495 audio clips totalling 436:04:23 of audio in English with the corresponding translations in Japanese.

Background

End-to-end speech-to-text translation (ST) has recently witnessed an increased interest given its system simplicity, lower inference latency and less compounding errors compared to cascaded ST (i.e. speech recognition + machine translation). End-to-end ST model training, however, is often hampered by the lack of parallel data. Thus, we created CoVoST, a large-scale multilingual ST corpus based on Common Voice, to foster ST research with the largest ever open dataset. Its latest version covers translations from English into 15 languages---Arabic, Catalan, Welsh, German, Estonian, Persian, Indonesian, Japanese, Latvian, Mongolian, Slovenian, Swedish, Tamil, Turkish, Chinese---and from 21 languages into English, including the 15 target languages as well as Spanish, French, Italian, Dutch, Portuguese, Russian. It has total 2,880 hours of speech and is diversified with 78K speakers.

Fields

• path: Filename of the audio file

• sentence: The sentence in the source language

• translation: The sentence in the target language

• client_id: The ID of the speaker of the source language, used for maintaining hygiene in the splits.

Example

['path\tsentence\ttranslation\tclient_id\n', 'common_voice_en_19664034.mp3\t"These data components in turn serve as the ""building blocks"" of data exchanges."\tこれらのデータ構成要素は次にダータ交換の「構成単位」の役目を果たします。\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664035.mp3\tThe church is unrelated to the Jewish political movement of Zionism.\t教会はユダヤ教の政治運動、シオニズムとは無関係です。\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664037.mp3\tThe following represents architectures which have been utilized at one point or another.\t以下はある時期に活用された建築を象徴しています。\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n', 'common_voice_en_19664038.mp3\tAdditionally, the pulse output can be directed through one of three resonator banks.\tさらに、パルス出力は3つの共振器バンクのうちの1つを通して方向づけることができます。\t4f29be8fe932d773576dd3df5e111929f4e222422322450983695eaa8625a12659cd3e999a061a29ebe71783833bebdc2d0ec6b97e9a648bf6d28979065f85ad\n']

Splits

Citation

If you use this dataset in your work please cite

@misc{wang2020covost,
    title={CoVoST 2: A Massively Multilingual Speech-to-Text Translation Corpus},
    author={Changhan Wang and Anne Wu and Juan Pino},
    year={2020},
    eprint={2007.10310},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}