Deep learning enables urban change profiling through alignment of historical maps
summary
The gist
The gist: This framework proposes a fully automated, deep learning–based framework for fine-grained urban change analysis from large collections of historical maps, built on a modular design that
In short
This framework uses deep learning to automatically analyze urban changes from historical maps. It first aligns different map editions by correcting spatial differences, then detects specific urban features like buildings using advanced segmentation, and finally quantifies changes over time. This allows for systematic, quantitative tracking of how cities evolve historically without manual comparison.
Key concepts
- Map Alignment
- This step corrects geometric errors between historical maps so they can be compared accurately. It unifies resolution, crops them to the same area, and converts coordinates to a shared pixel system. A deep learning model then estimates the precise shift (displacement) between map pairs using self-supervised training.
- Instance Extraction
- This involves using an AI network, specifically Mask2Former, to automatically find and outline urban objects like buildings or parks on the maps. It treats these objects as distinct entities, which is crucial for tracking individual changes over time rather than just looking at the whole map.
- Change Profiling
- Once features are extracted from aligned maps, this stage compares their shapes across different years. It uses a metric called Intersection over Union (IoU) to measure how much the geometry of an object has changed between two consecutive map editions, quantifying the intensity of urban transformation.
Terminology used across episodes
This episode discusses
The paper
Deep learning enables urban change profiling through alignment of historical maps · Read on arXiv
Sidi Wua, Yizi Chena, Maurizio Gribaudib, Konrad Schindlerc, Clément Malletd, Julien Perretd, Lorenz Hurnia
Institute of Cartography and Geoinformation ETH Zurich · CRH École des hautes études en sciences sociales EHESS
Prior to modern Earth observation technologies, historical maps provide a unique record of long-term urban transformation and offer a lens on the evolving identity of cities. However, extracting consistent and fine-grained change information from historical map series remains challenging due to spatial misalignment, cartographic variation, and degrading document quality, limiting most analyses to small-scale or qualitative approaches. We propose a deep-learning-based framework for fine-grained urban change analysis from large collections of historical maps, built on a modular design that integrates spatial map alignment, multi-temporal object extraction, and change estimation. This framework shifts the analysis of historical maps from ad hoc visual comparison toward systematic, quantitative characterization of urban change. Experiments demonstrate the robust performance of the proposed alignment and object extraction methods. Applied to Paris between 1868 and 1937, the framework reveals the spatial and temporal heterogeneity in urban transformation, suggesting its potential relevance for research in the social sciences and humanities. The modular design of our framework provides flexibility for future adaptation to different cartographic contexts and downstream applications.
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: We're looking at the paper: "Deep learning enables urban change profiling through alignment of historical maps".
Jane: Here's the gist of the paper. The gist: This framework proposes a fully automated, deep learning–based framework for fine-grained urban change analysis from large collections of historical maps, built on a modular design that integrates dense map alignment, multi-temporal object detection, and change profiling.
Tom: How it works The proposed pipeline consists of three main stages: map alignment, instance-level extraction, and fine-grained change analysis The two first steps are designed to be agnostic to any quantitative and qualitative analysis while the last one is presented here to illustrate the high relevance of such generic outputs for social and human sciences Given geo-referenced historical map archives, we first rectify maps depicting the same locations into a common image plane by unifying spatial resolution, cropping to the same extent, and converting geographical coordinates into pixel coordinates with a shared origin This enables subsequent dense alignment across map editions and suitable qualitative and quantitative assessment for thematic end-users Map Alignment The framework addresses severe geometric misalignments and significant diversity, such as cartographic variations, by introducing a unified computational framework that enables dense alignment and fine-grained change detection across historical map editions The first step rectifies maps depicting the same locations into a common image plane by unifying spatial resolution, cropping to the same extent, and converting geographical coordinates into pixel coordinates with a shared origin Subsequently, we estimate dense displacement fields between map pairs and use them for precise pixel-wise alignment Since ground-truth displacement fields between historical maps are not available, we adopt a self-supervised deep learning training strategy inspired by
29: During training, we synthesize paired images with known displacement fields by applying combinations of geometric transformations We further refine displacement predictions by enforcing triplet cycle consistency across multiple images, including both the real image pair and synthetically warped image This consistency is used to refine the displacement estimation FbI'→J and FbJ→I Our method achieves comparable alignment accuracy while producing markedly smoother displacement fields with substantially higher temporal consistency Instance Extraction Based on the aligned maps, an instance detection network identifies urban infrastructures such as buildings, building blocks, and parks We adopt Mask2Former
38: , a state-of-the-art transformer-based instance segmentation framework, as our baseline to identify building units—defined as closed-shape polygons in our approach To improve robustness against graphic defects and local ambiguities, we incorporate multi-temporal information from multiple map editions, leveraging complementary cues across time We evaluate instance extraction performance using average precision (AP), computed by aggregating predictions across all available years to jointly assess spatial accuracy and temporal stability Our model improves the overall accuracy and reduces the interquartile range and number of outliers when using our proposed multi-map fusion strategy compared to single-map inference Change Profiling Changes are detected by directly comparing instance geometries across time We aggregate individual building instances into building blocks (or urban blocks) defined by the road network and quantify temporal change using an Intersection over Union (IoU)–based indicator The block-level change indicator was then obtained by averaging IoU scores within each block across two consecutive years Across the full study period, change intensity is highly uneven in both space and time in Figure 6 The decade spanning 1868–1878 stands out as the period of most intensive transformation, with systematically lower IoU values than in subsequent periods Benefits and Implications Detecting fine-grained change from historical maps is essential for many research fields but remains technically challenging due to severe spatial misalignments between map sheets and the often degraded graphic quality of earlier editions We advance the state of the art on both alignment and instance extraction, achieving improved accuracy over existing methods The framework shifts change detection on historical maps from ad hoc visual comparison to a quantitative, instance-based analysis Fine-grained urban representations derived from historical maps provide a foundation for reference datasets capturing the long-term evolution of urban form and individually significant buildings in cities covered by large-scale historical mapping Transferability The proposed framework is readily transferable to a wide range of spatio-temporal mapping applications, especially due to its modular designs The self-synthesis strategy used for training can be readily adapted to other object classes, such as roads, hydrographic features, vegetation, or land-use parcels by substituting appropriate vector templates and map symbols The alignment model is adaptable to maps with varying cartographic styles, scales, types, and projection systems provided that the maps are geo-referenced to a common coordinate system Furthermore, the label propagation and temporal fusion strategies supported by the framework are applicable to sequential geospatial datasets with arbitrary temporal resolution and sequence length Limitations The framework assumes that historical maps are geo-referenced to a common coordinate system to provide an initial coarse correspondence The current approach does not explicitly address cases where geo-referencing is missing or substantially inaccurate and such errors may propagate to downstream alignment and change analysis The alignment model is designed for topographic and cadastral maps produced under relatively consistent cartographic standards, and its performance may degrade for highly schematic maps or early editions characterized by extreme abstraction The current change representation treats all detected changes uniformly and does not distinguish between varying levels of importance of different objects in urban studies Additional Applications The displacement fields computed during alignment constitute a valuable output in their own right, providing a quantitative description of geometric distortions between map editions Object-level alignment further enables the linking of individual features, such as buildings, parcels, or street segments, across temporal sequences without requiring manual correspondence annotation Alignment-derived correspondences enable label propagation across map editions, substantially reducing the need for repeated manual vectorization These applications highlight how alignment outputs can be reused to support a range of analytical tasks within historical cartographic datasets Evaluation Metrics We measure the smoothness of the displacement field using mean variation (mV), which calculates the average of the absolute gradient between neighboring pixels We evaluate temporal consistency by computing the L1 difference between displacement fields estimated from consecutive year triplets Image-level comparison uses the structural similarity index (SSIM) to measure the image similarity Object-level comparison uses Chamfer distance (CD) to measure the average shortest distance between objects from two sets Instance-level comparison uses the average precision (AP) score to evaluate the accuracy for instance segmentation The AP is based on the precision and recall score, where a predicted instance is considered correct if its Intersection over Union with the matched ground-truth instance exceeds a predefined threshold θ Data and Synthesis Our study utilizes historical urban planning maps from the Atlas Municipal, spanning 16 individual map sheets and their subsequent editions between 1868 and 1937 For data synthesis, we synthesize object changes, text displacements, as well as displacement between maps Change synthesis involves generating a modified copy from the original image under four scenarios: “addition” if the foreground objects are pasted in the copy, “deletion” if the foreground objects are pasted in the original image, “replacement” if both addition and deletion happen, and “unchanged” if no foreground objects are used<ref:2602
Title and authors: Tom: So we're looking at this paper called "Deep learning enables urban change profiling through alignment of historical maps". It sounds like they’re using deep learning to figure out how cities have changed over time by aligning these old maps. Jane, what do you make of that title?
Jane: I think the title is pretty descriptive because it immediately tells you the two big parts: deep learning and urban change profiling through alignment of historical maps. It suggests they’re tackling a major problem in history and geography where we have lots of old map collections but they are all just not lined up correctly.
Tom: Exactly. The core idea is that standard methods struggle because the maps don't match up geometrically, and this framework uses a modular approach to fix those mismatches first, then detect the changes. It's a lot of moving parts for an AI pipeline.
Lu: From my perspective, what’s interesting is how they structure it as three main stages: dense map alignment, instance-level extraction, and then change profiling. They aren't trying to solve everything at once; they’re breaking the complex problem into these manageable steps.
Meng: Breaking it down helps with deployment. If you have a system that fails at one step, you know exactly where the breakdown is before you waste time processing huge datasets. That modularity sounds good for building something robust.
Lalam: I see how it works by first rectifying maps to a common image plane by unifying spatial resolution and converting coordinates so everything shares a common origin, which lets them do dense alignment across different map editions. It sets up the whole process before they even look for changes.
The paper's summary: Jane: So if I’m hearing right, the paper is proposing this fully automated, deep learning framework to analyze urban change from large collections of historical maps by integrating dense map alignment, multi-temporal object detection, and change profiling. Tom, can you explain what that means in simpler terms?
Tom: It means they take these old maps that are messy and misaligned—with different resolutions or projections—and use AI to first make them match up perfectly on a common grid. Once they’ve got the alignment right, then their instance detection network finds things like buildings, and finally, they compare those objects across time to quantify exactly what has changed.
Lu: The key part is how they handle the alignment itself. Since they don't have perfect ground-truth displacement fields between historical maps, they use a self-supervised deep learning strategy inspired by some other work to synthesize paired images with known displacement fields by applying geometric transformations during training.
Meng: Self-supervised training sounds clever, but what’s the practical implication for data? Does it require a massive amount of perfectly labeled historical pairs just to train the alignment part?
Tom: Well, they use that self-supervision and then refine their displacement predictions by enforcing triplet cycle consistency across multiple images, including both the real image pair and synthetically warped image. This helps them get smoother displacement fields with higher temporal consistency than other methods.
Lalam: And for change detection, they aggregate individual building instances into building blocks defined by the road network, and then quantify the temporal change using an Intersection over Union indicator based on IoU scores between two consecutive years. That gives them a block-level change indicator.
The paper's improvements: Jane: Okay, focusing on what this approach actually improves compared to what’s out there, Tom, what are the main advancements they claim in terms of accuracy or robustness?
Tom: They claim they advance the state of the art on both map alignment and instance extraction. Specifically for alignment, they achieve comparable accuracy while producing markedly smoother displacement fields with substantially higher temporal consistency. That smoothness is a big deal because it means more reliable data for change detection later on.
Lu: The improvement in instance extraction comes from using Mask2Former as a baseline but then incorporating multi-temporal information from multiple map editions to improve robustness against graphic defects and local ambiguities in the maps. They evaluate this by aggregating predictions across all available years to assess spatial accuracy and temporal stability jointly.
Meng: So, when you look at change profiling, they mention that the decade spanning one thousand eight hundred sixty-eight to one thousand eight hundred seventy-eight stands out as a period of most intensive transformation, showing systematically lower IoU values than later periods <ref:2602.02154#pg1>. That gives them a specific quantitative insight into *when* the biggest changes happened.
Tom: Right. They shift change detection away from ad hoc visual comparison toward a quantitative, instance-based analysis based on these aligned map objects. The core improvement is moving from subjective assessment to a systematic, measurable quantification of urban change across space and time.
Jane: So, the overall improvement is making this process quantitative and stable enough that it can support comparative, long-term analyses for historical research that were previously limited by visual guesswork.
Conclusion: Tom: So we’ve covered how they tackle the alignment using self-supervised learning, how they use instance extraction with multi-map fusion, and how they quantify change through block-level IoU scores. It’s a solid pipeline for turning messy historical maps into quantifiable change data.
Jane: It really boils down to taking something that was previously hard to do manually—comparing old maps—and making it a systematic, quantitative process powered by deep learning, which opens up new avenues for urban and environmental research.
Lu: The implication is that we can generate fine-grained urban representations from historical maps that capture the long-term evolution of urban form in cities covered by large-scale historical mapping.
Meng: From a deployment standpoint, if this works as claimed, it means we could automate tracking detailed changes in historical maps across space and time without needing exhaustive manual delineation for every single building.
Lalam: And the displacement fields themselves are a valuable output because they provide a quantitative description of the geometric distortions between map editions, which is useful for studying cartographic reliability across different historical periods or publishers.
Tom: So we’ve discussed the "Deep learning enables urban change profiling through alignment of historical maps" paper. It’s a lot of heavy lifting to get that alignment right, but the result is a quantitatively rigorous way to study how cities transform over time based on these map collections.
Jane: That’s what it is. We've moved from guessing what changed to measuring exactly how much it changed and where. Thanks for tuning in.
More episodes
- 2402.05453-Mitigating Privacy Risk in Membership Inference by Convex-Concave Loss
- 2406.04261-Simulating, Fast and Slow: Learning Policies for Black-Box Optimization
- 2408.01503-Physics Inspired Neural Networks Enable Efficient Graph Coloring
- 2410.13925-FiTv2: Scalable and Improved Flexible Vision Transformer for Diffusion Model
- 2412.05735-REGE: A Method for Incorporating Uncertainty in Graph Embeddings
- 2412.10128-Feature Selection for Latent Factor Models
- 2502.06970-Weight Space Learning for Certifiable Few-shot Transfer Learning
- 2503.00626-Dissecting the Impact of Model Misspecification in Data-driven Optimization
- 2505.22509-Accelerating Optimization via Differentiable Stopping Time
- 2505.23442-Rethinking Generalization in Knowledge Graph Embedding: An Empirical Study and Sparse Peak Regularization