CogBench-SC: 100 Scenarios for Measuring High-Order Social Cognition

CogBench-SC is a contamination-resistant dataset containing 100 scenarios designed for measuring high-order social cognition. The dataset is hosted on Kaggle, but specific details about its creator, organization, and last update date are not provided. Its size, row count, and file formats are also unknown.

Use Cases

• Benchmarking AI models on high-order social reasoning tasks based on the described scenarios.
• Training models to understand and navigate complex social situations based on scenario content.
• Developing contamination-resistant evaluation protocols for social cognition benchmarks.
• Studying the performance of large language models on nuanced social tasks.

Strengths

• Contains 100 distinct scenarios for evaluation.
• Designed to be contamination-resistant, a key feature for reliable benchmarking.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Description metadata is limited; actual data quality requires manual inspection after download.

Provenance

Source

Kaggle

Collection Method

Likely curated or synthesized for benchmarking purposes.

Time Range

null

Freshness

Last update date is unknown; freshness unverified.

Geography

null