Reddit Comments And Submissions From Pushshift Archive

Pushshift Reddit contains a large-scale archive of user submissions and comments from the social media platform Reddit. The dataset, compiled by fddemarco, was last updated in May 2023 and is hosted on Hugging Face. It is categorized as containing over 100 million to 1 billion data points, primarily from US-based subreddits.

Use Cases

• Analyze comment_text and submission_title for sentiment trends across different subreddit communities.
• Train language models on informal, conversational text using the body of user comments and posts.
• Study temporal patterns in online discussion by analyzing post_timestamp data across the dataset's time range.
• Perform network analysis by linking user_id to their submitted posts and comments within threads.

Strengths

• Dataset size is categorized as between 100 million and 1 billion data points, indicating a large sample.
• Includes data from US-based subreddits, providing a focus on English-language online discourse.

Limitations

• Specific column names, row counts, and exact time range are unknown, limiting precise analysis planning.
• Data is sourced from the Pushshift archive, which may have gaps or be incomplete after Reddit's API changes in 2023.
• The last update was in May 2023, making the data stale for analyzing recent Reddit trends or platform changes.

Provenance

Source

Pushshift.io Reddit archive.

Collection Method

Collected via the Pushshift API, which historically archived public Reddit content.

Freshness

Last updated 2023-05-30; update frequency is null.

Geography

Primarily United States (based on platform tags).