SANE Schema-aware Natural-language Evaluation of Biological Data

Name: SANE Schema-aware Natural-language Evaluation of Biological Data
Uploaded: 2026-10-06T12:42:00.764638+00:00
Duration: 334 s
Description: SANE is a framework that automatically generates structured text-to-SQL benchmarks from real biological database contents and experimental designs. It evaluates few-shot large language models by testing their ability to write accurate SQL queries for complex microscopy data without any model training or fine-tuning, achieving high accuracy through schema-aware prompting.

SANE is a framework that automatically generates structured text-to-SQL benchmarks from real biological database contents and experimental designs. It evaluates few-shot large language models by testing their ability to write accurate SQL queries for complex microscopy data without any model training or fine-tuning, achieving high accuracy through schema-aware prompting.

Open the full episode