Verifier finds ~40% of accepted LLM-generated GPU kernels are broken

The paper presents a verifier for AI-generated GPU kernels built on twelve adversarial property-based gates, most of them tolerance-free; it agrees with reference correctness code 98.5% of the time. The authors used it to audit 2,638 publicly accepted machine-generated kernels: 39.5% were broken beyond any tolerance argument, and 62.1% had at least one violation. Field-standard tests accepted 1,487 kernels that the verifier rejected.

For any team shipping LLM-generated code validated only by loose tests, this is a directly actionable warning: property-based adversarial gates belong in kernel and code CI.