Wikipedia Articles on Indian Context in Six Indic Languages

Bhasha Wiki Indic Context contains Wikipedia articles filtered and translated for Indian context. The dataset provides full cleaned articles with translations into six Indian languages, curated by Soket AI Labs. The specific row count, column structure, and file size are not provided in the input.

Use Cases

• Train a multilingual language model on parallel text from English articles and their six Indic language translations.
• Analyze the distribution of topics related to India across the cleaned Wikipedia articles.
• Build a machine translation system for English to multiple Indian languages using the article translation pairs.
• Perform cross-lingual information retrieval by indexing the English and translated Indic article contents.

Strengths

• Provides content in six Indian languages, enabling multilingual NLP research.
• Articles are specifically filtered and cleaned for Indian context, offering focused cultural and topical data.
• Dataset was last updated in April 2024, indicating recent maintenance.

Limitations

• The dataset's size, row count, and specific column structure are unknown, making it difficult to assess scale and schema.
• The exact six Indian languages included are not specified, limiting precise application planning.
• The cleaning and translation methodology details are not provided, which could affect reproducibility.

Provenance

Source

Wikipedia articles from wikimedia/wikipedia.

Collection Method

Articles were filtered, cleaned, and translated from English into six Indian languages.

Freshness

Last updated on 2024-04-10.

Geography

India and Indian context.