News Articles from Global Sources Under Creative Commons Licenses

News articles scraped from over 20 international publishers that release content under CC BY or CC BY-SA licenses. The dataset is hosted by common-pile on Hugging Face and was last updated on June 6, 2025. Sources include outlets such as 360info, Africa is a Country, Alt News, Global Voices, and Meduza.

Use Cases

• Train language models for news summarization based on the multilingual text corpus.
• Analyze media narratives and framing across different global regions based on the listed publisher sources.
• Study the characteristics and distribution of openly licensed journalistic content.
• Perform cross-lingual information retrieval using articles from diverse linguistic backgrounds.

Strengths

• Articles are sourced from over 20 named publishers, providing a diverse set of outlets.
• Content is explicitly sourced from publishers using permissive Creative Commons (CC BY or CC BY-SA) licenses.

Limitations

• The specific number of articles, file formats, and column-level schema are unknown.
• The description metadata is limited; actual data quality requires manual inspection after download.
• Row count is unknown, which may limit suitability assessment for large-scale training.

Provenance

Source

Common-pile on Hugging Face.

Collection Method

Scraped from news sites that publish under CC BY or CC BY-SA licenses, according to opennewswire.

Freshness

Last updated 2025-06-06 03:57:37; freshness should be verified.

Geography

Global, based on the international list of publishers (e.g., Africa is a Country, Balkan Diskurs, New Canadian Media).