Large language models create an uneven informational layer over cities

summary

The gist

Large language models act as an uneven informational layer over cities, shaping which places people discover, consider…

In short

Researchers audited three LLMs' restaurant recommendations across 304 neighborhoods in five U.S. cities using diverse user profiles. They found LLMs fabricate venues and systematically overlook real ones, patterns linked to neighborhood characteristics. Grounding models with verified data stops fabrication, but coverage deficits persist as a selective attention property of the AI infrastructure.

Key concepts

Fabrication vs. Invisibility
LLMs do two types of errors: they invent restaurants that don't exist (fabrication), especially in areas with weak digital presence. They also systematically ignore many real, good places even when given a list of actual venues (invisibility). These patterns are tied to neighborhood socioeconomic factors.
Allocative Failure Hypothesis
This hypothesis suggests LLMs make choices based on how they allocate resources or attention. The study found that the fabrication and overlooking patterns align with neighborhood socioeconomic characteristics, indicating that the models' filtering is driven by these underlying economic and social structures.
Algorithmic Visibility Predictors
LLMs prioritize venues based on their existing digital and physical footprint—like visit volume, spending habits, and review counts—rather than quality ratings. This means popular or well-reviewed places get amplified, creating a hierarchy where existing success dictates future exposure.
Demographic Stratification of Lifestyles
LLMs filter information differently based on user demographics. Higher-income users are directed toward venues that are less frequented and farther away, suggesting the models associate wealth with an exploratory urban lifestyle rather than just affording more expensive options.

Terminology used across episodes

This episode discusses

The paper

Large language models create an uneven informational layer over cities · Read on arXiv

Lin Chen, Guangyuan Weng, Esteban Moro

Network Science Institute, Northeastern University · Department of Physics, Northeastern University · Khoury College of Computer Sciences, Northeastern University

Large language models (LLMs) are emerging as a new informational layer over cities, shaping which places people discover, consider, and ultimately visit. Yet little is known about which places they surface, which they ignore, and whether these patterns vary across communities and users and translate into real-world economic consequences. Here, we audit restaurant recommendations from five LLMs across 304 neighborhoods in five U.S. cities using 320 synthetic user profiles spanning income, age, sex, and residential status, issuing nearly one million queries. We find that LLMs both fabricate venues and systematically overlook real ones. Fabrication is concentrated in neighborhoods with weaker digital and physical footprints and virtually disappears when models are provided with verified venue lists. In contrast, invisibility persists: even when choosing from a fixed set of real venues, 41.5% of establishments are never recommended, and nearly one-fifth of venues are overlooked by all five models, indicating that uneven visibility reflects not only missing knowledge but also systematic patterns of selective attention that are shared across models. The same selectivity extends to users. Within identical venue pools, higher-income users receive more expensive and less popular venues, while tourists are directed toward costlier but more socially diverse establishments than local residents. Simulating the resulting shifts in consumer demand suggests that widespread reliance on LLM recommendations would redirect visits and revenue away from chain and quick-service restaurants toward independent and full-service dining. Together, our findings show that LLMs act as a selective layer of urban information that unevenly distributes visibility across places and people, with potential consequences for local economies and urban inequality.

Transcript

Introduction to the show: ident: Computer Science. The day in computer science: software, systems and theory on arXiv.

Tom: I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "Large language models create an uneven informational layer over cities".

Title and authors: Tom: So the authors are Lin Chen, Guangyuan Weng, and Esteban Moro. They’re looking at this uneven layer over cities issue head-on >

Jane: The title itself is pretty telling; it suggests that the problem isn't just about bad recommendations, but about a fundamental way these models organize our understanding of urban space >

Lu: It sets up a crucial distinction between what we call epistemic failure, which is when the model just doesn't know something because we didn't tell it >

Meng: Versus allocative failure, which is when the model knows everything but just chooses to ignore some things on purpose, and that distinction matters for how we fix it >

Tom: Exactly. The paper explores whether these uneven results are just missing data that needs adding, or if there's a built-in bias in how they select what to show us >

Lalam: And they suggest it’s both, but the patterns they find point toward something more persistent than just missing facts >

The paper's summary: Jane: So the summary is that when you test these LLMs, you see fabrication happening mostly in neighborhoods with weaker digital and physical footprints >

Tom: They found that if you give the models a verified list of venues, that fabrication disappears almost entirely, dropping the hallucination rates to near zero under candidate constraint >

Lu: That’s one way they test it; grounding failure is epistemic and remediable because providing verified venue data eliminates fabrication completely >

Meng: But then you have this invisibility problem where even when you restrict the choice to only real venues, forty-seven point five percent of establishments are never recommended >

Lalam: And that invisibility persists, meaning thirty-one point nine percent of these blind spots are shared across all three model families they tested >

The paper's improvements: Tom: So the paper suggests a few ways to tackle this uneven layer, starting with how we test it better >

Jane: They improved their method by using parallel experimental settings, one open-ended and one constrained specifically to verified local venues >

Lu: That lets them disentangle the two failure hypotheses—the epistemic gap versus the selective attention—which is a big step forward for understanding why things are wrong >

Meng: And they also found that grounding failure can be fixed by simply providing verified data, which is a pretty clean solution for hallucination >

Lalam: But they also point out that the coverage deficit isn't just a knowledge gap; it’s an allocative and persistent property of the LLM infrastructure itself >

Conclusion: Tom: So wrapping up, the main implication is that LLMs aren't just randomly messing up recommendations; they are systematically filtering information based on neighborhood characteristics >

Jane: And this filtering isn't random either; it’s linked to socioeconomic factors, suggesting a different kind of infrastructure is being built over the city >

Lu: They found that higher-income users get directed toward venues that are simultaneously less frequented and located farther away, which implies the models are inferring a certain lifestyle from the user data >

Meng: That’s interesting because it suggests they're not just recommending what people can afford, but how they are expected to move through the city >

Lalam: And they also showed that algorithmic visibility is tied to real-world visit volume and digital footprint, meaning popularity amplifies existing hierarchies across the food economy >

Tom: So, in short, this paper on "Large language models create an uneven informational layer over cities" shows us that we need to look at these models not just as recommendation tools but as new ways they structure urban visibility >

More episodes

← Home