Embedding-Bias in Conditional Independence Testing
The study investigates how conditioning data on an embedding, instead of the original variable, can invalidate tests for conditional independence. It shows that a robust test requires controlling for 'insufficiency'—a tolerance level related to how much information is lost in the embedding. This leads to a more reliable statistical test when dealing with pre-trained encoders.