arXiv AI/ML OCR Benchmark Corpus: 100,056 Page Images

100,056 rasterized page images from arXiv AI/ML papers serve as a benchmark corpus for OCR tasks. The dataset, created by obswork, contains pages rendered at 144 DPI from 4,866 source PDFs and was last updated on 2026-04-19. Images are encoded as WebP and packed into Parquet shards for automatic decoding via Hugging Face datasets.

Use Cases

• Benchmark OCR accuracy on scientific documents based on rasterized page images.
• Train document layout analysis models based on the structure of AI/ML paper pages.
• Evaluate image-based document retrieval systems using categorized arXiv pages.
• Develop multimodal models that combine text and visual information from academic papers.

Strengths

• Contains 100,056 individual page images, providing a substantial corpus.
• Pages are categorized by arXiv subfield (cs.AI, cs.CV, cs.LG, stat.ML), enabling domain-specific analysis.
• Images are processed at a consistent 144 DPI and encoded for efficient storage and loading.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Freshness should be verified as the last update timestamp is 2026-04-19.
• The dataset's license is unknown, which may restrict certain uses.

Provenance

Source

Curated page-bounded dataset obswork/arxiv-ai-ml-100k-pages from arXiv.

Collection Method

Pages were rasterized from source PDFs.

Freshness

Last updated 2026-04-19 19:02:10