ChartX & ChartVLM: A Benchmark for Multimodal Chart Reasoning

ChartX & ChartVLM is a benchmark and foundation model designed to evaluate the ability of Multi-modal Large Language Models to query and reason with information from visual charts. The dataset was created by InternScience and was last updated on Hugging Face in December 2024. It is intended to comprehensively and rigorously test chart understanding and reasoning capabilities.

Use Cases

• Benchmarking chart understanding performance of MLLMs based on the described visual query and reasoning tasks.
• Training foundation models for visual chart reasoning as indicated by the associated ChartVLM model.
• Analyzing the limitations of current MLLMs in interpreting complicated charts as referenced in the description.

Strengths

• Specifically designed as a benchmark for a focused capability—chart reasoning—as stated in the description.
• Associated with a foundation model (ChartVLM), suggesting a practical application for the data.
• Last updated on 2024-12-18, indicating recent maintenance.

Limitations

• Description metadata is limited; actual data quality, size, and structure require manual inspection after download.
• Column-level documentation is absent; field semantics must be inferred after download.
• Row count and file formats are unknown, which may limit suitability assessment.

Provenance

Source

InternScience via Hugging Face.

Freshness

Last updated 2024-12-18 01:34:16.