Spanish Public Domain Books with 13.9 Billion Words

Spanish-PD-Books is a corpus of 302,640 individual texts containing 13.9 billion words. The collection aggregates Spanish monographies in the public domain from sources including the Biblioteca Digital Hispánica.

Use Cases

• Train large language models on 13.9 billion words of Spanish text for natural language processing tasks.
• Analyze linguistic patterns and vocabulary evolution across the corpus of Spanish monographies.
• Conduct cultural heritage research using the aggregated public domain texts from Spanish institutions.

Strengths

• Corpus contains 302,640 individual texts, making it the biggest Spanish open corpus as of March 2024.
• The collection aggregates 13.9 billion words of Spanish language data.
• Sourced from multiple institutions, including the leading cultural heritage body Biblioteca Digital Hispánica.

Limitations

• Specific columnar structure, file formats, and licensing information are not provided in the input.
• The dataset's temporal coverage and geographic specificity within Spain are unknown.
• Sample data is unavailable, making initial inspection of text quality and formatting difficult.

Provenance

Source

Multiple sources, including Biblioteca Digital Hispánica.

Collection Method

Aggregated from Spanish public domain monographies.

Freshness

Last updated on 2024-07-29.

Geography

Spain