Improving Minority Population Sampling with BISG Probabilities: Evidence from a Survey of Jewish Americans
summary
The gist
The paper proposes Bayesian Improved Surname Geocoding (BISG) to enhance the efficiency of sampling geographically dispersed minority populations…
In short
The study developed Bayesian Improved Surname Geocoding (BISG) to efficiently sample Jewish Americans using names and addresses. This method generates membership probabilities, which are then used in a stratified Poisson sampling design. The approach achieves high efficiency, producing survey results nearly identical to a much more expensive Pew Research Center survey at a fraction of the cost.
Key concepts
- Bayesian Improved Surname Geocoding (BISG)
- A statistical method that uses Bayesian hierarchical models to estimate the probability of an individual belonging to a minority group. It combines information from geo-located surnames in obituary data with first name details to create a more accurate membership prediction.
- Stratified Poisson Probability Sampling
- A sampling design where the target sample size for each geographic stratum is determined using the calculated BISG probabilities. This method optimizes how many people to sample from different areas to ensure representation while maintaining statistical efficiency.
- Efficiency Gains
- The benefit of using BISG is that it allows researchers to achieve results comparable to expensive, detailed surveys much more cheaply. The method demonstrated substantial gains, yielding estimates closely aligned with those from a costly survey for a fraction of the expense.
Terminology used across episodes
This episode discusses
- Improving Minority Population Sampling with BISG Probabilities: Evidence from a Survey of Jewish Americans · Paper Radio
- Estimating Racial Disparities When Race is Not Observed
- Using Embedding Models to Improve Probabilistic Race Prediction · Paper Radio
The paper
Improving Minority Population Sampling with BISG Probabilities: Evidence from a Survey of Jewish Americans · Read on arXiv
Department of Statistics, Harvard University · Department of Political Science, Tufts University · Department of Government, Harvard University
Sampling geographically dispersed minority populations poses substantial challenges when individual group membership cannot be directly observed. Although stratified sampling can offer efficiency gains, these gains are typically modest unless the minority population is highly concentrated within a small number of strata. In this paper, we propose using Bayesian Improved Surname Geocoding (BISG) to enhance the efficiency of minority population sampling. BISG generates individual-level probabilities of minority group membership based on names and residential addresses. We incorporate these probabilities into a stratified Poisson probability sampling design. Applying the proposed approach to a national survey of Jewish Americans, we find that our estimates closely align with those from a large-scale Pew Research Center survey of the same population, which relied on a substantially more expensive sampling strategy involving geographic stratification and screening. At a fraction of the cost, our survey reproduces nearly identical patterns observed by Pew, including estimates of religious denomination prevalence and participation in specific religious activities.
Transcript
Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.
Tom: I'm Tom.
Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.
Tom: We're looking at the paper: "Improving Minority Population Sampling with BISG Probabilities".
Jane: Here's the gist of the paper. The paper proposes Bayesian Improved Surname Geocoding (BISG) to enhance the efficiency of sampling geographically dispersed minority populations, specifically focusing on a national survey of Jewish Americans.
Tom: BISG generates individual-level probabilities of minority group membership based on names and residential addresses.
Jane: These probabilities are then incorporated into a stratified Poisson probability sampling design, aiming to improve upon standard disproportionate stratified sampling methods.
Tom: The methodology involves leveraging BISG probabilities within a stratified Poisson sampling framework, allowing for the optimal allocation of stratum-level target sample sizes using these probabilities.
Paper summary: Tom: So to wrap up this discussion on "Improving Minority Population Sampling with BISG Probabilities: Evidence from a Survey of Jewish Americans", the authors are proposing using BISG probabilities within a stratified Poisson probability sampling design to efficiently sample dispersed minority populations.
Jane: The main implication is that even when you can't individually identify people in your frame, you can use this name and location-based probability method to get results that are comparable to expensive surveys like the Pew Research Center survey.
Meng: It makes the process way cheaper for organizations trying to understand these specific communities. It turns a much more costly data collection effort into something much more manageable.
Lu: The work shows that this approach is robust, meaning it stays valid even if those initial BISG probabilities are biased, provided you handle non-response correctly in your final analysis.
Tom: The paper suggests that for sampling the American Jewish population, BISG provides a way to get high success rates, which is what matters when you're trying to gather reliable data on a specific group.
Jane: It’s about using sophisticated statistical modeling to overcome real logistical hurdles in minority population research.
Lalam: The final point is that the BISG method, with filtering applied, achieves a sample size of forty-nine thousand people and produces results comparable to established methods like Pew's survey, which is what they claim holds up under scrutiny on page one of this work >
Conclusion: Tom: So, we're wrapping up on this paper about improving how we sample minority groups using something called BISG probabilities for Jewish Americans.
Jane: It really boils down to taking names and where people live to get a better idea of their group membership, which you can then use in a sampling plan.
Lu: The core idea is building these probabilities using Bayesian hierarchical models that look at data from Jewish obituary records, specifically linking surnames and first names to geographic locations.
Meng: From an engineering standpoint, it’s smart because it lets us allocate our survey resources more efficiently based on those calculated probabilities instead of just picking random people.
Tom: The authors show that this method gets results that are surprisingly close to what a much bigger, more expensive survey like Pew Research Center found.
Jane: They point out they're talking about saving a huge amount of money—about twenty-three dollars per person compared to two hundred twenty-eight for a full interview.
Lu: And the success rate for their proposed Poisson sampling method with filtering is estimated above fifty-eight point six percent for a target sample size of fifty thousand people, which is quite high compared to simple random sampling.
Meng: That's good because we’re dealing with real data at scale, and that success rate suggests the model isn't just theoretical noise.
Tom: The paper validates a predictive model estimating Jewish identity based on name and geography for registered voters, which is a big step for targeted research.
Jane: It shows that even if you can't directly ask everyone in the group, this probability approach gives you estimates that align well with established benchmarks.
Lu: They did find some interesting correlations between state distributions estimated by AJPP and the actual obituary locations, though they noted California and New York were a bit under-represented while Florida was over-represented.
Meng: So it’s not perfect, but those kinds of localized biases are exactly what we need to fix when we deploy these systems in production.
Tom: The title itself says "Improving Minority Population Sampling with BISG Probabilities," which perfectly captures the mechanics and the goal of making sampling more precise.
Jane: And the implication is that for researchers, especially those studying smaller, dispersed communities, this can be a very cost-effective way to get high-quality data.
Lu: It opens up a new way to integrate name and place data into larger survey designs without needing expensive individual interviews for every single person.
Tom: This moves us from just counting what we find in existing records to building models that predict group membership across a whole population structure.
Jane: If this works consistently, it suggests that we can build more accurate demographic pictures of specific groups using the information already available in public, record-based datasets.
More episodes
- Daily Summary for 2026-11-19
- 2310.07973-Statistical Performance Guarantee for Subgroup Identification with Generic Machine Learning
- 2408.09155-Learning Robust Treatment Rules for Censored Data
- Daily Summary for 2026-11-19
- 2603.23397-Kinetic Langevin Splitting Schemes for Constrained Sampling
- 2606.09906-An information-geometric framework for mapping maximum potential biodiversity
- 2603.27718-Induced replication and the assessment of models
- 1307.0898-Entropy of a Zipfian Distributed Lexicon
- 2406.19974-Generalizing self-normalized importance sampling with couplings
- 2412.10213-Collaborative Optimal Design of Controlled Experiments with Subject Covariates