The day in conversation for 2026-10-21
discussion
Transcript
The discussion: Tom: I was looking at the citation paper today; it’s strange how those LLMs seem to systematically prioritize recent, shorter papers over the established highly cited ones, which feels counterintuitive if they are supposed to be summarizing established scientific knowledge. Jane: That preference for recency suggests a strong weighting on what's currently in the training corpus rather than historical impact or foundational theory. Have we considered how that impacts long-term knowledge stability when those short papers are less rigorously peer-reviewed? Lu: From a system design perspective, it implies the loss function might be overly sensitive to current temporal signals instead of semantic density derived from high citation counts. But does this trend hold true across different domains, or is it specific to literature that requires rapid turnover? Meng: It seems domain-specific. I’m more interested in the operational side—if the models are optimizing for recent citations, how does that affect their ability to retrieve nuanced data points from older, highly cited texts where the core methodology might be sound but presented differently? Lalam: That leads into something else we saw: the work on PiSAs. If an
More episodes
- 2505.16254-Human-AI Writing as Distributed Cognition: Reassessing Collaborative Writing Theories in the Age of LLMs
- 2506.10913-Choreographic Quick Changes: First-Class Location (Set) Polymorphism
- 2507.14812-A Black-Box Approach for Exogenous Replenishment in Online Resource Allocation
- 2507.15448-Frames over finite fields with respect to the Galois inner product and their connections to self-orthogonal and LCD codes
- 2508.21572-NewsReX: An Open-Source Multi-Framework for Neural News Recommendation
- 2509.17028-Impact of Packetization on Network Calculus Analysis
- 2510.17342-AoA Services in 5G Networks: A Framework for Real-World Implementation and Systematic Testing
- 2511.04088-Efficient and rate-optimal list-decoding in the presence of minimal feedback
- 2511.17264-Notes on Stack Machines and Quantum Stack Machines
- 2601.15318-On the closest balanced game