Github Python 1M: One Million Python Source Code Files

1,000,000 Python source code files extracted from public GitHub repositories. The collection provides raw script content intended for large-scale natural language processing and code generation tasks.

Use Cases

• Train a generative model for Python code completion using the raw script content
• Conduct large-scale static analysis of Python coding patterns across 1 million files
• Benchmark tokenization strategies on a specialized Python-only corpus

Strengths

• 1,000,000 individual Python files
• Sourced from public GitHub repositories
• Contains raw source code text for every entry