Cohen's Kappa Statistical Analysis for All Models on Test Set

Ummer Shakeel published a statistical analysis of model performance on a test set in May 2026. The dataset contains Cohen's Kappa scores for multiple models, stored in a 5.5 KB Excel file. It is licensed for reuse under CC-BY-4.0.

Use Cases

• Compare inter-rater reliability across multiple models based on the reported Cohen's Kappa scores.
• Benchmark classification model performance on a common test set using a statistical agreement metric.
• Validate model consistency for tasks where chance agreement is a concern, as suggested by the use of Cohen's Kappa.

Strengths

• Dataset is small (5.5 KB), facilitating quick download and inspection.
• Uses a standardized statistical measure (Cohen's Kappa) for model comparison.
• Released under a permissive CC-BY-4.0 license for broad reuse.

Limitations

• Row count and specific column definitions are unknown, limiting immediate assessment of scope and structure.
• Description metadata is limited; actual data quality requires manual inspection after download.

Provenance

Source

Ummer Shakeel via figshare.

Collection Method

Statistical analysis of model outputs on a test set.

Time Range

Analysis likely corresponds to the models' evaluation period, but the specific date range is not provided.

Freshness

Last updated 2026-05-07 17:41:06; freshness should be verified.

Geography

Geographic scope is not specified.