Reddit Writing Prompts Dataset for Language Model Training

A processed collection of Reddit writing prompts converted from ShareGPT data. The dataset has undergone deduplication, grammar correction, and filtering to remove NSFW content, deleted posts, and duplicate conversational turns. It was last updated on November 13, 2024 by the author ChaoticNeutrals.

Use Cases

• Fine-tune language models for creative writing based on structured prompt-response pairs.
• Train dialogue agents on conversational turns derived from Reddit interactions.
• Generate synthetic training data for story generation tasks using curated prompts.
• Benchmark text generation models on a cleaned corpus of user-submitted narratives.

Strengths

• Data has been processed with min-hash deduplication to reduce redundancy.
• Content has been filtered to remove NSFW material and deleted user posts.
• Grammar correction has been applied to improve text quality for training.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• The original data source and temporal coverage are not specified.

Provenance

Source

Reddit via ShareGPT conversion pipeline.

Collection Method

Converted, deduplicated, and filtered using a custom processing script.

Freshness

Last updated 2024-11-13 00:04:11