GitHub Major Repos: Metadata for Commit History

A metadata-only dataset of GitHub commits designed for large-scale code model pretraining. The dataset is created by author adhyanshaa and was last updated on June 5, 2026. It aims to provide a solution for training models on open-source software history without requiring full data downloads.

Use Cases

• Train large-scale code models based on commit metadata.
• Analyze patterns in open-source software development history.
• Benchmark AI models for software engineering tasks using commit sequences.
• Study code evolution and project lifecycle trends from commit data.

Strengths

• Designed specifically for large-scale AI pretraining, indicating a focus on scale.
• Offers a metadata-only approach, which likely reduces storage and management overhead.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Description metadata is limited; actual data quality requires manual inspection after download.

Provenance

Source

GitHub

Collection Method

Likely extracted from GitHub repositories using a metadata-only approach.

Freshness

Last updated 2026-06-05 13:03:48; freshness should be verified.