Large Scale Colloquial Persian Language Understanding Dataset

LSCP Dataset provides an enhanced, large-scale collection for colloquial Persian language understanding. The dataset was created by researchers from the Institute for Advanced Studies in Basic Sciences, Charles University, and Petanux GmbH. It was last updated on the Hugging Face platform in October 2024.

Use Cases

• Training language models on colloquial Persian text features to improve fluency in informal contexts.
• Benchmarking model performance on Persian natural language understanding tasks using the provided text samples.
• Analyzing linguistic patterns and variations specific to informal Persian language within the corpus.

Strengths

• Dataset is described as 'Large Scale' and 'Enhanced', indicating a substantial text corpus.
• Supported by multiple academic and commercial institutions, suggesting a level of curation.

Limitations

• Specific scale metrics like row count, file size, and column details are unknown.
• The license is restrictive for commercial use (CC BY-NC-ND 4.0).

Provenance

Source

Institute for Advanced Studies in Basic Sciences (IASBS), Charles University, and Petanux GmbH.

Collection Method

null

Time Range

null

Freshness

Last updated on the Hugging Face platform on 2024-10-31.

Geography

Primarily Persian-language (Farsi) regions, with a focus on colloquial usage.