CoreCodeBench-Multi: Multi-Testcase Code Generation Benchmark

CoreCodeBench-Multi is a dataset for benchmarking code generation models, created by meituan-longcat and last updated on May 15, 2025. It contains multi-test cases for evaluating function completion tasks. The dataset includes a standard version and a more difficult version.

Use Cases

• Benchmarking code generation models based on multi-test case evaluation.
• Training models for function completion tasks based on unique identifiers for functions.
• Assessing model performance on difficult coding problems based on the 'difficult' version of the dataset.

Strengths

• Dataset includes a 'difficult' version for more challenging evaluation.
• Last updated on 2025-05-15 12:41:59, indicating recent maintenance.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Description metadata is limited; actual data quality requires manual inspection after download.

Provenance

Source

huggingface

Freshness

Last updated 2025-05-15 12:41:59