Coding MCQ Reasoning: 3,549 Programming Questions with GPT-4o Explanations

3,549 selected coding multiple-choice questions derived from the CodeMMLU benchmark. Each question is enriched with detailed reasoning steps provided by a GPT-4o teacher model. The dataset was created by author 'tuandunghcmut' and last updated on April 1, 2025.

Use Cases

• Training language models to generate step-by-step explanations for coding problems based on the provided reasoning steps.
• Evaluating the reasoning capabilities of AI models on programming multiple-choice questions.
• Creating educational resources for programming students by using the question and explanation pairs.
• Benchmarking model performance on code comprehension and logical reasoning tasks.

Strengths

• Contains 3,549 individual coding questions, providing a substantial collection for analysis.
• Includes detailed reasoning steps for each question, likely generated by a GPT-4o model.
• Derived from the established CodeMMLU benchmark, suggesting a structured foundation.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Last updated 2025-04-01 09:03:22; freshness should be verified.

Provenance

Source

Derived from the CodeMMLU benchmark.

Collection Method

Questions were selected and enriched with reasoning steps by a GPT-4o teacher model.

Freshness

Last updated 2025-04-01 09:03:22.