Universal distribution of the empirical coverage in split conformal prediction
The episode discusses a paper on split conformal prediction that determines the exact distribution of empirical coverage for finite batches (Beta-Binomial) and the limiting distribution for infinite batches (Beta). The hosts conclude that this provides a practical calibration size table, allowing practitioners to choose calibration data based on desired coverage precision and confidence level.