Metric-Construction Coupling Inflates Measured Synthetic Dialect Recovery
The research investigated how synthetic supervision recovers data loss for low-resource languages like Korean. It found that recovery estimates are heavily inflated when the metric used to score synthetic output shares a common inventory with the rules used to generate that output. This coupling means metrics can be confounded by construction access, leading to overly optimistic recovery figures.