Can Crowdsourcing Survive the LLM Era? A Community Survey on Human Data Collection

Name: Can Crowdsourcing Survive the LLM Era? A Community Survey on Human Data Collection
Uploaded: 2026-10-17T07:15:10.149164+00:00
Duration: 327 s
Description: A survey of 155 NLP researchers explored how large language models (LLMs) affect crowdsourced data collection. Findings show 44% observe LLM usage, with concerns about data homogeneity and validity. Researchers use detection methods like style patterns, but current mitigation efforts are insufficient, suggesting crowdsourcing needs a rethink.

A survey of 155 NLP researchers explored how large language models (LLMs) affect crowdsourced data collection. Findings show 44% observe LLM usage, with concerns about data homogeneity and validity. Researchers use detection methods like style patterns, but current mitigation efforts are insufficient, suggesting crowdsourcing needs a rethink.

Open the full episode