When Can You Trust Neural Critics? Auditing Mutual Information Estimates of Higher-Order Epistasis in Protein Language Models
cs.LG
Submitted: 2026-11-06
Updated: 2026-11-06
Terminology
Sources
- Accurate Estimation of Mutual Information in High Dimensional Data
- NMINE: Normalized Mutual Information Neural Estimation
- Towards Diverse and Comprehensive Benchmarks for Mutual Information Estimation
- ORBIT-FMIB: Tracking Order-Resolved Epistatic Information Through ESM-2
- The Leaderboard Illusion
- On Recovering Higher-order Interactions from Protein Language Models
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis