AG News Subset for Automated Model Evaluation

Autoevaluate's staging project contains a subset of the AG News dataset, used for testing automated evaluation pipelines. The dataset was uploaded by the user 'autoevaluate' to Hugging Face in July 2022. Its specific size and row count are not detailed in the provided metadata.

Use Cases

• Benchmarking text classification models on news article content and categories.
• Testing automated evaluation pipelines using news headline and description fields.
• Analyzing model performance on the four standard AG News topic classes: World, Sports, Business, Sci/Tech.

Strengths

• Based on the established AG News benchmark corpus.
• Provides a standardized testbed for evaluation system development.

Limitations

• Exact sample size, split details, and potential modifications from the original AG News are unknown.
• Data is from 2022 and may not reflect current news trends or evaluation needs.

Provenance

Source

Derived from the AG News dataset, uploaded by user 'autoevaluate'.

Collection Method

Likely a curated subset or staging version for an evaluation platform.

Time Range

Original AG News articles are from 2004-2005; this staging version created circa 2022.

Freshness

Last updated 2022-07-08; no update frequency specified.

Geography

News articles are primarily in English, with global coverage.