EpiSEM-Bench exposes unsafe agent actions when tools omit critical evidence

Fri, 23 Oct 2026 16:04:55 GMT

EpiSEM-Bench uses 300 matched safe and unsafe task pairs where every tool statement is true but one fact needed to judge permission is omitted. Across ten models, unsafe execution, active evidence recovery and correct post-recovery action vary substantially. Providing a recovery path reduces unsafe action for every model but does not ensure agents use it. No public implementation was found.

Recommendation: WATCH

Sources: EpiSEM-Bench: Evaluating Safety and Evidence Recovery in LLM Agents under Missing Evidence

MATRIX · EpiSEM-Bench

EpiSEM-Bench exposes unsafe agent actions when tools omit critical evidence