Pre-1929 U.S. Books, Over 130,000 Digitized Texts

Over 130,000 books published in the United States before 1929, which entered the public domain in 2024. The collection was identified using the HathiTrust bibliographic catalog and contains digitized OCR plain text files downloaded from the Internet Archive. It was compiled by common-pile and last updated on Hugging Face in June 2025.

Use Cases

• Train language models on historical English text based on the pre-1929 corpus.
• Analyze linguistic and thematic shifts over time based on the public domain book collection.
• Study copyright and public domain impacts on digital archives based on the 2024 copyright expiration event.
• Develop OCR post-processing tools based on the raw plain text files from the Internet Archive.

Strengths

• Contains over 130,000 digitized books, providing a substantial corpus.
• Focuses on a clearly defined temporal and legal boundary (U.S. works pre-1929).
• Leverages authoritative bibliographic data from HathiTrust and digitization from the Internet Archive.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Data may reflect temporal and source bias inherent to the digitization and cataloging processes of the contributing libraries.

Provenance

Source

HathiTrust bibliographic catalog (Hathifiles) and Internet Archive digitized texts.

Collection Method

Books identified via catalog query, with OCR plain text files downloaded from the Internet Archive.

Time Range

Publications before 1929.

Freshness

Last updated 2025-06-06 03:58:46; freshness should be verified.

Geography

United States.