Reddit DPO: Filtered Social Media Posts for Direct Preference Optimization

A text dataset derived from euclaise/reddit-instruct, filtered to remove samples containing hyperlinks in either the post or comment. Rejected columns were generated with the nbeerbower/Mahou-1.5-mistral-nemo-12B-lorablated model. The dataset was last updated on February 1, 2025.

Use Cases

• Training Direct Preference Optimization (DPO) models based on filtered Reddit posts and comments.
• Benchmarking language model performance on instruction-following tasks based on social media data.
• Studying the effect of hyperlink removal on model training and performance degradation.
• Generating synthetic rejected responses for preference learning pipelines using the specified model.

Strengths

• Data is filtered to remove hyperlinks, which may reduce noise and improve text quality for language model training.
• Rejected columns are generated using a specific, named model (Mahou-1.5-mistral-nemo-12B-lorablated), providing traceability for the synthetic data.

Limitations

• Description metadata is limited; actual data quality requires manual inspection after download.
• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.

Provenance

Source

Derived from euclaise/reddit-instruct dataset on Hugging Face.

Collection Method

Filtered to remove samples with hyperlinks; rejected columns generated synthetically.

Freshness

Last updated 2025-02-01 11:23:46; freshness should be verified.