How Should Transformers Encode Numeric Values in Electronic Health Records?
The study systematically compared discrete, continuous, and hybrid methods for encoding numeric values in Electronic Health Record (EHR) transformers. It found that explicit value-concept modeling via FiLM offers high precision for arithmetic tasks. Hybrid binning provides a robust alternative for scalability. The main takeaway is that approximate reasoning is often sufficient for EHR applications.