SoK: Where Do Flow Labels Come From? Auditing Label Provenance in Encrypted Traffic Benchmarks
The episode analyzes the paper "SoK," which identifies three major gaps in encrypted traffic benchmarks: task disagreement, shortcut labels, and data exclusion. Hosts discuss how these flaws lead to performance overestimation. They conclude that rigorous auditing of the entire data pipeline is necessary for reliable AI development.