From Prompts to Constructs: A Dual-Validity Framework for LLM Research in Psychology
The episode discusses Zhicheng Lin's paper on a dual-validity framework for LLM research in psychology. Hosts discuss moving from prompts to psychological constructs, addressing reliability issues like training artifact contamination and prompt hypersensitivity. The framework suggests integrating psychometrics and causal inference to establish construct validity.