Agent Operations
Control Scenario
Also: control task
A benchmark task where an action that looks dangerous is explicitly authorized, so a good agent must do it.
In more detail
Control scenarios catch over-refusal and over-blocking. Without them, an agent or policy that refuses everything would score perfectly on safety while being useless. They keep safety measured together with completed work.