AGIEval JEC-QA-CA: A Chinese Question Answering Benchmark for Foundation Models

AGIEval is a human-centric benchmark for evaluating foundation models. This dataset contains the JEC-QA-CA subtask, which likely contains Chinese question-answering data. The dataset was processed from the AGIEval repository by the user 'hails' and was last updated on the Hugging Face platform on 2024-01-26.

Use Cases

• Benchmarking foundation model performance on Chinese question answering based on the JEC-QA-CA task.
• Training or fine-tuning models for legal or general-domain QA in Chinese, as suggested by the dataset's origin.
• Conducting research on AI evaluation methodologies using a structured benchmark dataset.

Strengths

• Derived from the established AGIEval benchmark, which is cited in academic literature.
• Last updated on 2024-01-26, indicating recent maintenance on the hosting platform.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Description metadata is limited; actual data quality requires manual inspection after download.

Provenance

Source

AGIEval repository on GitHub (Microsoft).

Collection Method

Processed from the AGIEval benchmark, following the methodology of existing datasets on the Hugging Face hub.

Freshness

Last updated 2024-01-26 18:41:44.