Loading datasets...
Release Date: 4/14/2026
Format: TXT
Size: 145.27 MB
Share
This dataset serves as a comprehensive longitudinal news corpus for the Tajik language, sourced from Radio Ozodi (ozodi.org), the Tajik service of Radio Free Europe/Radio Liberty (RFE/RL). Spanning from June 2000 to March 2026, the corpus contains 166,721 unique articles, totaling over 20 million tokens across Tajik and Russian texts. The dataset captures the historical record and linguistic evolution of the region over a quarter-century, intentionally preserving the small subset of Russian articles published alongside the core Tajik content while discarding negligible English fragments. The files are formatted as plain text with YAML front-matter metadata, making them ready for linguistic analysis, search indexing, and cultural preservation research.
Licensing
Creative Commons Attribution Non Commercial Share Alike 4.0 International (CC-BY-NC-SA-4.0)
https://spdx.org/licenses/CC-BY-NC-SA-4.0.htmlRestrictions/Special Constraints
When using RFE/RL text content in full, we require that you credit RFE/RL by including: • A permanent link, placed before the text of the article, to the original article on www.rferl.org or www.ozodi.org • The following text in the article: Copyright (c) 2026 RFE/RL, Inc. Used with the permission of Radio Free Europe/Radio Liberty You must also refrain from altering or distorting the meaning, name, or integrity of the product. When using excerpts of RFE/RL text content, we require that you note that the material is an excerpt and link to the original content somewhere in your text. When translating RFE/RL text content into another language, we require that you note that the material is a translation, state the original language of the text, and provide a link to the original content somewhere in your text. The translated text must not alter or distort the meaning, name, or integrity of the content.
Forbidden Usage
• The sale of RFE/RL content is prohibited. • The use of RFE/RL content in advertisements or endorsements is prohibited. • The use of RFE/RL content to train artificial intelligence (AI) systems is prohibited.
This corpus was extracted from the archives of Radio Ozodi (ozodi.org), the Tajik Service of Radio Free Europe/Radio Liberty.
Total Articles: 166721
Time Period: 2000-06 to 2026-03
Languages:
Tajik (tg): 164874 articles (~19750467 tokens)
Russian (ru): 1847 articles (~471792 tokens)
Note on Processing & Multilingual Content:
Language Detection: The language of each article was identified
automatically using the pycld2 Python package (version 0.42).
Multilingual Articles: As a multilingual project, Russian articles
published alongside the Tajik content have been preserved
(ozodi.ru.txt) as potential parallel texts or regional supplementary
coverage. Small fragments of English text detected by the parser
have been discarded as negligible.
Paragraph Structure: Paragraph breaks from the original HTML were preserved to the extent possible.
Formatting: Text has been wrapped at 80 characters for easier inspection in terminal environments. This wrapping is done strictly on whitespace; no words were split or chunked apart.
The dataset is provided as text files based on detected language:
ozodi.tg.txt
ozodi.ru.txt
Inside the files, each article is delimited by a YAML Front Matter block containing metadata, followed by the full article text.
url: The canonical URL of the original article.
title: The headline of the article.
date: Publication date (ISO 8601 format: YYYY-MM-DD).
script: The writing system used (cyrl for Tajik/Russian).
lang: The detected language code (tg or ru).
All content is the property of RFE/RL, Inc. and is protected by U.S. and international copyright laws.
Users of this dataset must adhere to the RFE/RL Terms of Use. Specifically, users must credit RFE/RL in any reuse:
Copyright (c) 2026 RFE/RL, Inc. Used with the permission of Radio Free Europe/Radio Liberty.
