CoderForge-Preview: Open Test-Verified Coding Agent Dataset

CoderForge-Preview is a test-verified coding agent dataset containing between 100,000 and 1,000,000 records, released by togethercomputer in February 2026. It provides trajectories for training software engineering agents and has demonstrated a performance increase from 23.0% to 59.4% pass@1 on the SWE-Bench Verified benchmark when used for fine-tuning.

Use Cases

• Fine-tuning large language models using test-verified trajectories to improve software engineering capabilities
• Training agents to execute specific tool-use sequences for code generation
• Benchmarking model performance against the SWE-Bench Verified standard

Strengths

• Contains between 100,000 and 1,000,000 records
• Test-verified trajectories ensure the validity of the coding solutions
• Demonstrated 36.4% absolute improvement on SWE-Bench Verified for 32B parameter models

Limitations

• Trajectories were generated using a single scaffold and a fixed tool set with no permutations
• Limited adaptability to different agent scaffolds or diverse tool-use frameworks

Provenance

Source

togethercomputer

Collection Method

Synthetic or model-generated trajectories using a fixed scaffold and tool set.

Freshness

Last updated February 2026.

Geography

United States