A benchmark you really don’t want models to be saturated with.
Scores indicate count of illegal activity. Higher is… you decide.
Felony Bench counts unique instances where AI agents affect third-party entities. Escaping a sandbox alone does not constitute a counted incident. It is for these reasons that Frontier Security’sKimi K3incident andAlibaba’s ROMEincident are not counted.