Counterfactual VLM Benchmark Data for Vision-Language Model Evaluation

Counterfactual VLM Benchmark Data is a dataset payload for evaluating vision-language models. It was authored by JingyuSun and uploaded to Hugging Face on May 20, 2026. The dataset is intended to be used with an associated GitHub repository containing download and evaluation scripts.

Use Cases

• Benchmarking model robustness based on counterfactual scenarios mentioned in the description
• Evaluating vision-language model reasoning based on the benchmark's test suite
• Training models for counterfactual understanding based on the benchmark's data payload

Strengths

• Dataset is explicitly linked to a GitHub repository with download and evaluation scripts, suggesting structured usage
• Upload timestamp of 2026-05-20 09:28:50 indicates recent availability

Limitations

• Row count, file formats, and column-level documentation are unknown, which may limit suitability assessment
• Description metadata is limited; actual data quality and content require manual inspection after download

Provenance

Source

Hugging Face dataset repository by JingyuSun

Collection Method

Uploaded as a data payload for a benchmark; likely generated or curated for the associated project.

Time Range

Upload date is 2026-05-20; temporal coverage of the data itself is unknown.

Freshness

Last updated 2026-05-20 09:28:50

Geography

null