Spoiler Alert: Narrative Forecasting as a Metric for Tension in LLM Storytelling

Existing story evaluation methods fail to measure narrative tension because they focus on surface drama rather than withheld information. The researchers introduced the '100-Endings' metric, which operationalizes tension as unpredictability by measuring how often a language model fails to predict a story's ending at every sentence. A new generation pipeline based on literary theory was then used to inject this tension into LLM stories, significantly improving their narrative quality.

Open the full episode

More from AI Radio