A Statistical Inference Framework for PMI Estimation and SGNS Word Embeddings
stat.ML, cs.LG, math.ST, stat.TH
Submitted: 2026-10-04
Updated: 2026-10-04
Terminology
Sources
- On the Properties and Estimation of Pointwise Mutual Information Profiles
- Revisiting Skip-Gram Negative Sampling Model with Rectification
- Correspondence Analysis and PMI-Based Word Embeddings: A Comparative Study
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- Efficient quadratic entropy with distance sketches
- Embedding-Bias in Conditional Independence Testing
- From Log-Odds to Shapley Values: An Explanatory Geometry for the Weighted Naive Bayes Classifier