FastKernels: Benchmarking GPU Kernel Generation in Production
The paper addresses flaws in current GPU kernel generation benchmarks that don't simulate real production environments. The authors created FASTKERNELS, a framework that acts as a benchmark-as-framework, allowing agents to generate kernels within actual serving pipelines like vLLM. This means agents can produce faster, more compatible kernels ready for deployment, rather than just passing isolated tests.