Replication Package for Code Comprehensibility Metrics Study

Replication package for a paper presented at ICSE '21 on how showing code metrics influences understanding. The data folder contains the dataset, R analysis script, and figures needed to reproduce the study's statistical analysis. Authors from the University of Stuttgart removed potentially identifying fields like age and gender for privacy, but state the dataset still allows full reproducibility.

Use Cases

• Reproducing statistical analysis on code comprehension based on the provided R script and dataset.
• Studying the effect of code comprehensibility metrics on human understanding based on the experimental task data.
• Analyzing participant performance in code understanding tasks using the provided code snippets and task sheets.

Strengths

• Includes a complete R analysis script to reproduce all statistical analysis and figures from the ICSE '21 paper.
• Contains the experimental materials, including code snippets and task sheets, allowing for methodological review.
• Data was anonymized by removing specific fields like age and gender to protect participant privacy.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Last update date is unknown; freshness unverified.

Provenance

Source

University of Stuttgart

Collection Method

Data from a human study where participants performed code comprehension tasks.