Math Notebooks: IPython Notebooks Collated from OpenWebMath and RedPajama

Mathematically informative IPython notebooks were collated from sources including OpenWebMath, RedPajama, and the Algebraic Stack. The AutoMathText effort used Qwen 72B to score text excerpts based on mathematical quality. This dataset was created by author 'casey-martin' and last updated on Hugging Face in May 2024.

Use Cases

• Training mathematical reasoning models based on scored educational content.
• Benchmarking text quality filters for scientific and educational datasets.
• Analyzing the structure and pedagogical value of IPython notebooks for STEM education.

Strengths

• Content was scored for mathematical quality using the Qwen 72B model.
• Sources include established collections like OpenWebMath and RedPajama.
• Dataset was updated on the Hugging Face platform on 2024-05-16.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Description metadata is limited; actual data quality requires manual inspection after download.

Provenance

Source

Collated from OpenWebMath, RedPajama, and the Algebraic Stack.

Collection Method

Text excerpts were scored by Qwen 72B as part of the AutoMathText effort.

Freshness

Last updated 2024-05-16 16:00:34; freshness should be verified.