GENIE: A Fine-Grained Measure for Novelty
Large Language Models lack creativity, so this work proposes GENIE, a fine-grained metric to measure response novelty based on task-specific features. It works by automatically discovering features like SETTING and PLOT for creative writing and quantifying how novel a response is across these specific dimensions compared to a reference population.