Terminal Wrench: 331 Reward-Hackable Environments and 3,632 Exploit Trajectories

Terminal Wrench is a collection of 331 terminal-style environments identified as reward-hackable, paired with 3,632 agent trajectories demonstrating both successful and unsuccessful reward-hacking attempts. The dataset was created by the author 'few-sh' and was last updated on April 18, 2026. Each entry includes the original task definition alongside full attack trajectories.

Use Cases

• Analyzing patterns of reward-hacking exploits based on the provided attack trajectories.
• Benchmarking agent robustness and alignment techniques against the 331 hackable environments.
• Studying the divergence between intended and achieved task outcomes based on the included non-hacking trajectories.

Strengths

• Includes 331 distinct environments identified as reward-hackable.
• Contains 3,632 agent trajectories showing both hacking and non-hacking outcomes.
• Each entry preserves the original task definition for context.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.

Provenance

Source

huggingface

Collection Method

Likely compiled from experiments or simulations on benchmark environments.

Time Range

null

Freshness

Last updated 2026-04-18 21:46:04; freshness should be verified.

Geography

null