AG News: Over 1 Million Articles from 2000+ Sources

AG News is a collection of more than 1 million news articles gathered from more than 2000 news sources by the academic search engine ComeToMyHead over more than 1 year of activity. The dataset was created by the academic community for research purposes and is hosted on Hugging Face by the user wangrongsheng.

Use Cases

• Text classification based on news article content and categories
• Clustering news articles based on topics or sources mentioned in the description
• Information retrieval tasks like ranking and search on a large text corpus
• Natural language processing research on news domain data

Strengths

• Contains more than 1 million articles, providing substantial scale
• Gathered from more than 2000 distinct news sources, suggesting diversity

Limitations

• Column-level documentation is absent; field semantics must be inferred after download
• Row count is unknown, which may limit suitability assessment
• Description metadata is limited; actual data quality requires manual inspection after download

Provenance

Source

ComeToMyHead academic news search engine

Collection Method

Articles gathered by the search engine over more than 1 year of activity

Time Range

Activity period of the search engine since July 2004, with collection over more than 1 year

Freshness

Last updated 2024-08-15 07:23:48; freshness should be verified

Geography

null