A new framework tests LLM safety without relying on benchmarks

Researchers formalize benchmarkless comparative safety scoring for LLMs before labeled benchmarks exist. They specify contracts for scenario-based audits without ground-truth labels.

Researchers formalized benchmarkless comparative safety scoring for LLMs lacking ground-truth labels. This approach uses scenario-based audits to validate safety rankings across candidate models. It targets deployments in new languages, sectors, or regulations without existing benchmarks.