Generalizable Multiscale Segmentation of Heterogeneous Map Collections

arXiv:2603.05037 · cs.CV · Submitted 2026-03-05 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "Generalizable Multiscale Segmentation of Heterogeneous Map Collections".

Jane: Here's the gist of the paper. Historical map collections are highly diverse in style, scale, and geographic focus, often consisting of many single-sheet documents.

Tom: First, we introduce Semap, a new open benchmark dataset comprising 1,439 manually annotated patches designed to reflect the variety of historical map documents.

Jane: Second, we present a segmentation framework that combines procedural data synthesis with multiscale integration to improve robustness and transferability.

Tom: This work opens the way to integrating the long tail of cartographic archives to historical geographic studies.

Title and authors: Tom: So we're looking at this paper today about generalizable multiscale segmentation of heterogeneous map collections. It’s a big topic because historical maps are just so wildly different in style and focus, right?

Jane: Yeah, and the authors are trying to build something that doesn't just work for one type of map anymore. They’re looking at how to make these AI models actually handle all that variety instead of getting stuck on just one kind of document.

Lu: Exactly. The core idea is moving away from models that are only good for, say, a specific set of maps, and instead creating a system that can generalize across different collections. It’s about building something collection agnostic.

Meng: But generalizing sounds really hard when the data itself is so inconsistent. What kind of data are they even starting with to teach this model to handle all these differences?

Tom: They introduce a new benchmark dataset called Semap, which has one thousand four hundred thirty-nine manually annotated patches designed specifically to capture that variety in historical maps. This dataset is the foundation for testing their new segmentation framework.

Jane: So, Semap isn't just one big collection of maps; it's this curated set of patches meant to represent the diversity they’re worried about, which sounds like a smart starting point for training.

Lu: The authors mention that they created Semap by balancing it against existing annotated data while still capturing that unique variety. It took about four hundred hours of manual work to get those samples annotated, which tells you the effort involved in building this kind of diverse training set.

Meng: Four hundred hours is a lot of manual labor. When I look at deploying models, I worry about the cost and time associated with creating these kinds of large, diverse training sets for every new task we want to try.

Tom: They tackle that by using procedural data synthesis alongside multiscale integration in their segmentation framework. This means they are using generated data to supplement the real annotated samples.

Jane: Procedural synthesis sounds like they are trying to trick the AI into seeing more examples of what historical maps look like, even if those specific map types haven't been annotated yet. How much synthetic data are we talking about here?

Lu: They used contemporary reference geodata from MapTiler Planet to generate this synthetic data. They constrained how they sampled that geodata using the spatial coverage and scale distributions found in ADHOC images as their targets.

Meng: Constraining sampling based on existing image statistics sounds like a clever way to guide the synthetic generation process, trying not to just make random noise. But what happens when you apply these synthesized maps to real-world deployment? Will they still hold up under stress?

Title and authors: Tom: They then employ a stylization process on these synthetic maps. This involves applying graphical processes probabilistically, like plain colors, dotted patterns, hatchings, waterlines, texture masks extracted from Semap itself, and icon sprites.

Jane: So they’re not just generating random images; they are applying specific cartographic elements—like a watermark or a specific texture—to make the synthetic maps look visually plausible enough for the AI to learn from. That's an important detail for realism.

Lu: And that process is key because it’s designed to create visually plausible synthetic maps, which helps train the model without relying solely on scarce annotations for every possible map variation. It's a way to compensate for the lack of data in the long tail of archives.

Meng: I see why that would be useful for robustness, but generating stylized data can sometimes lead to style mode collapse, where you get very good results on the specific styles you trained it on, but it struggles when presented with a completely new look. Have they tested that risk?

Tom: They used a Mask2Former architecture with a Swin-L backbone for semantic segmentation. The training ran for three hundred forty-five thousand iterations using a multiscale composite loss function.

Jane: A mask transformer with a Swin-L backbone is quite sophisticated, suggesting they are aiming for high accuracy in figuring out exactly which parts of the map are which geographic features. And that loss function sounds like they’re trying to balance predicting the shape of the masks, figuring out what class each patch belongs to, and making sure they don't get confused by imbalanced classes using Dice loss.

Lu: The combination of binary cross-entropy for mask prediction, cross-entropy for class attribution, and dice loss to handle class imbalance is a standard but effective setup for segmentation tasks like this. It addresses the issue where some map features might be much more common than others.

Meng: From a deployment standpoint, three hundred forty-five thousand iterations is just training time. The real question is how well this model performs when it sees a map style completely outside of what it was trained on for inference in production environments.

Tom: And the performance metrics show strong results: they got a mean IoU of seventy-four point two percent on their Semap test set. Furthermore, the Mask2Former–Swin-L model, which they call few-shots, shows precision ranging from eighty point seven to ninety two point four percent across different geographic classes.

Jane: That range in precision sounds promising because it suggests that even within this diverse set of maps, the model isn't wildly biased toward just one class; it’s performing well everywhere. It’s showing consistency across geographic areas and publication contexts.

Title and authors: Lu: The results really support their main argument: that a diversity-driven approach to map recognition is viable. They show that these models produce both robust and collection agnostic recognition pathways, which is what they were aiming for when they started this work on "Generalizable Multiscale Segmentation of Heterogeneous Map Collections."

Meng: Collection agnostic is a big claim. If the model truly works across all those historical periods and geographic regions, it means we don't need to train a new specific model for every single archive we want to use. That would drastically reduce the deployment pipeline complexity for us.

Tom: The conclusion of this work points toward integrating this long tail of cartographic data into historical geographic studies. They argue that using the diversity found in these vast, varied archives is necessary to fully model how territories have evolved over time, which is what they are targeting with their work on "Generalizable Multiscale Segmentation of Heterogeneous Map Collections."

Jane: It really suggests that if we can successfully segment these maps consistently, it opens up the ability to study historical geography at a much deeper level than before, because we can finally use all that diverse data.

Lu: And they suggest procedural data synthesis and multiscale inference aren't just tricks; they are necessary tools to compensate for the scarcity of real annotations when dealing with such varied input sources. They show how controlled synthetic data can guide models toward morphology-grounded segmentation while avoiding style mode collapse inherent in image generation.

Meng: It sounds like the combination of real annotated data, synthesized procedural data, and that multiscale inference is what’s making this model stable enough for real use, even though I still have my doubts about generalizing it to completely unseen styles.

Tom: So to sum up, the Semap dataset and the framework they proposed show that diversity in training data isn't an obstacle but a catalyst for robust learning when paired with the right architecture. It’s a solid foundation for extracting geographic land classes from diverse map collections.

Jane: And because of this, we can start exploring how this segmentation capability changes how we approach historical mapping and geography studies by looking at those long tail archives they mentioned earlier.

Lu: We should keep watching how the model handles novel inputs, because that’s the next challenge after proving it works on Semap and HCMSSD.

Meng: For production, the immediate focus will be on seeing how much of this synthetic data we actually need versus how much real annotation we can afford to get for a specific domain.

Lalam: I am very confident in my analysis here; based on the training, it is highly probable that this framework will yield reliable results across varied map collections because the diversity of training data is explicitly shown to be a catalyst for robust learning.

The paper's summary: Tom: So, to sum up this paper, they’ve put together this new benchmark called Semap and built a system that can segment maps across tons of different styles and scales in one go.

Jane: It’s really about making AI models stop getting stuck on just one kind of historical map because they see that the diversity itself is what makes them learn better.

Tom: They used procedural data synthesis—basically generating realistic-looking synthetic maps using contemporary geography as a guide—to fill in the gaps where they didn't have enough real annotations.

Jane: And that synthetic data isn't just random; they apply graphical processes like waterlines and texture masks from the Semap set to make sure those generated images look cartographically plausible.

Tom: The model itself is Mask2Former with a Swin-L backbone, trained for three hundred forty-five thousand iterations using a composite loss function that balances mask prediction and class attribution.

Jane: And the results are pretty solid—they hit a mean IoU of seventy-four point two percent on their test set, which is high even across all those different map types.

Tom: What’s interesting is that this segmentation performance stays stable whether you look at maps from different geographic regions, or maps printed at different scales, or maps from totally different historical periods.

Jane: That stability suggests the model isn't just memorizing one style; it's actually learning the underlying structure of what a map feature *is*, regardless of how it’s drawn.

Tom: It means they’re not just building a tool for one specific archive anymore, but something that could work across the entire long tail of cartographic archives.

Jane: And that opens up this whole area for historical geography studies because you can finally use all those diverse maps to see how territories have actually evolved over time.

Tom: The real test now is figuring out if this collection agnostic approach holds up when you put it into a real-world production environment, which is where I get nervous about.

Jane: Exactly, because we need to know if this generalizability means it’s ready for actual use in mapping projects or just sitting there as a cool academic benchmark on arXiv.

The paper's improvements: Tom: So, they aren't just stopping at showing good results; they’re proposing some specific technical improvements to make this system even better than what they currently have for handling these varied maps.

Jane: What are those improvements? I mean, we know it works on the test set, but how do we make sure it doesn't break when we feed it a map style that was totally new?

Tom: One big suggestion is using a multiscale inference strategy. Instead of just looking at one resolution, they recommend running the inference at two different resolutions—the original and then half that resolution.

Jane: So, if you’re trying to identify a huge feature like a whole city block, you check it first at the high detail level and then get a consensus prediction when you look at it again at that lower resolution.

Tom: That should help with recognizing large objects spanning many map patches because it allows for consensus predictions while cutting down on the computational cost since you’re using less spatial resolution.

Jane: That makes sense for big things, but what about the smaller details, like tiny street names? Does this multiscale approach affect those fine features too?

Tom: It helps with the larger stuff primarily because of that reduced spatial resolution, but they are also focusing on improving the loss function.

Jane: What does that mean for training? Are they tweaking how much weight they give to predicting the mask versus correctly labeling the different classes in each patch?

Tom: They’re combining binary cross-entropy for predicting the mask shape, cross-entropy for class attribution, and dice loss to handle class imbalance.

Jane: That’s smart because it tackles two issues at once: getting the overall shape right and making sure it doesn't ignore classes that appear less frequently in the data.

Tom: And they’re using their own Semap set to extract texture masks, which they then use in the stylization process for synthetic data generation.

Jane: That means they are using the patterns found in real historical maps to guide how those AI-generated samples look, making them more realistic than just random noise.

Tom: So, the implication is that by combining this multiscale inference and this balanced loss function with their procedural synthesis, they should get a much more robust model.

Jane: It suggests that the method itself isn't just about the initial training data; it’s about how you structure the AI's thinking to handle complexity at different levels.

Tom: And if we look at this from a production standpoint, it means we have a path to deploy something that is more reliable across wildly different map collections without having to retrain everything every time we get a new type of map.

Jane: It’s moving the focus from just getting *a* result on *this* map type to getting dependable results on any map type you throw at it.

Conclusion: Tom: So we've covered how they built this system using Semap data and procedural synthesis to handle map diversity across scales, and now we’re wrapping up with the final thoughts on this paper, "Generalizable Multiscale Segmentation of Heterogeneous Map Collections."

Jane: It really boils down to this idea that diversity in training data isn't a problem; it's actually what makes the model robust enough to work everywhere.

Tom: Yeah, and they showed that by using procedural data generation alongside real annotations, you can get a solid foundation for training segmentation models without needing millions of perfectly labeled examples for every single map type.

Jane: That opens up this whole area for historical geography studies because suddenly we can use those vast, varied archives to understand how territories have actually evolved over time.

Tom: The results they showed with the mean IoU of seventy-four point two percent across all those contexts suggest that this approach is a solid way to extract geographic land classes from whatever map you feed it.

Jane: It’s interesting because it implies that if we can get the segmentation right, we can finally use all that long tail of cartographic archives for deeper historical research.

Tom: But I still have my concerns about deployment; how does this actually run on real-world traffic without needing constant retraining when the map styles change?

Jane: That’s a fair question, because the authors themselves flag that while it's generalizable, we need to monitor how well it performs on completely unseen map styles.

Tom: I agree; the caveat is that generalization is strong based on their tests, but real-world stress testing will show if it holds up under more pressure than a benchmark set.

Jane: Well said. We’ve seen how this segmentation capability changes how we approach historical mapping and geography studies by allowing us to finally look at those long tail archives they mentioned earlier.

Tom: Next up, we’re looking at some papers dealing with molecular structure elucidation using mass spectrometry data, which is a completely different kind of inverse problem.

Jane: That sounds like a shift from geographic segmentation to chemistry; I'm curious how the challenges are similar or different in those fields.

Lu: Well, the next paper tackles molecule-language model interaction for determining chemical structures from mass spectra using tandem mass spectrometry data. It’s an inverse problem in analytical chemistry, which is pretty complex.

Meng: Mass spectrometry data involves huge datasets, and if the AI misinterprets a structure even slightly, that could be a big failure at scale for any chemical analysis pipeline.

Lalam: I'm confident that this approach to using language models for chemical structure elucidation is sound because it handles the complexity of the spectral data well, and I’m sure it will yield accurate structural predictions.

Tom: We’ll see how their training on molecular data compares to what we just discussed with map segmentation, but it's definitely a different kind of engineering challenge.

Remi Petitpierre

EPFL · Swiss Federal Institute of Technology in Lausanne

cs.CV

Submitted: 2026-03-05

Updated: 2026-10-30

Comments: 33 pages, 16 figures

Code: https://github.com/open-mmlab/mmsegmentation

Project page: https://digihistch24.github.io/submissions/454

License: http://creativecommons.org/licenses/by/4.0/

Importance score: 87/100

The gist: Historical map collections are highly diverse in style, scale, and geographic focus, often consisting of many single-sheet documents.

Key concepts

Semap Dataset
This is a new open benchmark dataset containing 1,439 manually annotated historical map patches. It is designed to represent the wide variety of styles found in different historical maps, balancing existing annotated data with new samples.
Procedural Data Synthesis
This involves creating synthetic map data by applying graphical processes like patterns and textures to reference geodata. This technique generates visually plausible maps that help train models when real annotations are scarce.
Multiscale Integration
The framework uses two inference scales: the original resolution and half the resolution. This allows the model to make consensus predictions, which improves segmentation accuracy for large features while reducing computational effort.
Mask2Former–Swin-L Model
This is a specific deep learning architecture used for semantic segmentation. It uses a Swin-L backbone with mask attention to predict the boundaries of map features, achieving strong performance on diverse map collections.

Terminology

Summary

Historical map collections are highly diverse in style, scale, and geographic focus, often consisting of many single-sheet documents. p. 0

Where the paper says it

Laboratory of Urban Sociology (LASUR), School of Architecture, Civil and Environmental Engineering (ENAC). Abstract Historical map collections are highly diverse in style, scale, and geographic focus, often consisting of many single-sheet documents.

First, we introduce Semap, a new open benchmark dataset comprising 1,439 manually annotated patches designed to reflect the variety of historical map documents. p. 0
Where the paper says it

In contrast, this article aims to develop generalizable semantic segmentation models and ontology. First, we introduce Semap, a new open benchmark dataset comprising 1,439 manually annotated patches designed to reflect the variety of historical map documents.

Second, we present a segmentation framework that combines procedural data synthesis with multiscale integration to improve robustness and transferability. p. 0
Where the paper says it

First, we introduce Semap, a new open benchmark dataset comprising 1,439 manually annotated patches designed to reflect the variety of historical map documents. Second, we present a segmentation framework that combines procedural data synthesis with multiscale integration to improve robustness and transferability.

This work opens the way to integrating the long tail of cartographic archives to historical geographic studies. p. 0
Where the paper says it

The results indicate that segmentation performance remains largely stable across map collections, scales, geographic regions, and publication contexts. By proposing benchmark datasets and methods for the generic segmentation of historical maps, this work opens the way to integrating the long tail of cartographic archives to historical geographic studies.

Dataset Introduction

The authors introduce Semap, a new open benchmark dataset comprising 1,439 manually annotated patches designed to reflect the variety of historical map documents. This dataset is balanced to match ADHOC images while capitalizing on existing annotated data. p. 2

Where the paper says it

The Semantic Segmentation Map Dataset we present here, abbreviated Semap, consists of 1,439 manually annotated map samples. Semap is a composite dataset balanced to match ADHOC images while capitalizing on existing annotated data.

Semap consists of 1,439 manually annotated map samples. p. 2
Where the paper says it

This diversity is made possible by the Aggregated Database on the History of Cartography (ADHOC), a dataset containing a balanced sample of 99,715 digitized maps from 16 heritage collections in Europe and the United States. The Semantic Segmentation Map Dataset we present here, abbreviated Semap, consists of 1,439 manually annotated map samples.

The annotation process demanded approximately 400 hours of manual work. p. 2
Where the paper says it

Introducing this sixth class required updating all samples from HCMSSD and related datasets to include the supplementary label. In total, the annotation process demanded approximately 400 hours of manual work.

Data Augmentation Strategies

The training set includes synthetically generated data derived from MapTiler Planet contemporary reference geodata. The spatial coverage and scale distributions of ADHOC are used as target to constrain geodata sampling. p. 3

Where the paper says it

Here, synthetic images are derived from MapTiler Planet [62] contemporary reference geodata (Figure 2). In that prospect, the spatial coverage and scale distributions of ADHOC are used as target to constrain geodata sampling.

A stylization process is subsequently employed to generate visually plausible synthetic maps. p. 3
Where the paper says it

In total, 12,122 raster samples were collected using MapTiler Application Programming Interface (API). A stylization process is subsequently employed to generate visually plausible synthetic maps (Figure 3).

This stylization entails the probabilistic application of graphical processes to the template samples. p. 3
Where the paper says it

A stylization process is subsequently employed to generate visually plausible synthetic maps (Figure 3). Stylization entails the probabilistic application of graphical processes to the template samples.

The graphical processes implemented include plain color, dotted patterns, hatchings, waterlines, texture masks extracted from Semap, and icon sprites. p. 4
Where the paper says it

The graphical processes implemented include plain color (e. , Figure 3a, 3k), dotted patterns (e.

Model Architecture and Training

The authors rely on Mask2Former, a masked-attention Mask Transformer with a Swin-L backbone for semantic segmentation. The model was trained for 345,000 iterations with a batch size of 1 and a multiscale composite loss. p. 6

Where the paper says it

Data augmentation is limited to horizontal flipping. The model was trained for 345,000 iterations with a batch size of 1 and a multiscale composite loss.

The loss function combines binary cross-entropy (BCE) for mask prediction, cross-entropy (CE) for class attribution, and Dice loss to mitigate the issue of class imbalance. p. 6
Where the paper says it

At each stage, only the model that achieved the highest validation performance was retained (early stopping policy). The loss function combines binary cross-entropy (BCE) for mask prediction, cross-entropy (CE) for class attribution, and Dice loss [67] to mitigate the issue of class imbalance.

Performance and Generalization

The model achieves a mean IoU (mIoU) of 74.2% on the Semap test set. p. 7

Where the paper says it

Performance per class. Table 2 reports the semantic segmentation performance on Semap test set.

The Mask2Former–Swin-L (few-shots) model shows high precision, ranging from 80.7% to 92.4% across geographic classes. p. 7
Where the paper says it

4%, and a mean precision of 85. 4% across geographic classes.

The results indicate that segmentation performance remains largely stable across map collections, scales, geographic regions, and publication contexts. p. 0
Where the paper says it

This framework achieves state-of-the-art performance on both the HCMSSD and Semap datasets, showing that a diversity-driven approach to map recognition is not only viable but also beneficial. The results indicate that segmentation performance remains largely stable across map collections, scales, geographic regions, and publication contexts.

The model seems to perform consistently across archival collections, geographic locations, scales, and historical periods. p. 0
Where the paper says it

The results indicate that segmentation performance remains largely stable across map collections, scales, geographic regions, and publication contexts. By proposing benchmark datasets and methods for the generic segmentation of historical maps, this work opens the way to integrating the long tail of cartographic archives to historical geographic studies.

Conclusion

The proposed method delivers strong performance across diverse map contexts. This study indicates that diversity of training data, when paired with suitable architectures, is not an obstacle but a catalyst for robust learning. p. 1

Where the paper says it

Not only segmentation models can learn from varied datasets: they seem to benefit from this diversity, producing both robust and collection-agnostic recognition pathways. This situation brings about new perspectives for the use of map archives in historical geography, by opening the door to the long tail of cartographic data.

The successful integration of procedurally synthesized samples further shows that controlled synthetic data can compensate for scarce annotations and guide models toward morphology-grounded segmentation while avoiding the risk of stylistic mode collapse inherent with image generation and style transfer approaches. p. 2
Where the paper says it

Other works have shown that adversarial generative models can enrich the diversity of map samples through style transfer [55, 56]. Nevertheless, they also highlighted the difficulty of generating credible synthetic historical data directly from GIS-derived information or segmentation masks [57].

By enabling the extraction of geographic land classes from diverse map collections, generic models open the way to exploiting the long tail of cartographic archives. p. 0
Where the paper says it

The results indicate that segmentation performance remains largely stable across map collections, scales, geographic regions, and publication contexts. By proposing benchmark datasets and methods for the generic segmentation of historical maps, this work opens the way to integrating the long tail of cartographic archives to historical geographic studies.

The generalizability of the model is supported by procedural data synthesis, employed in complement to real data annotation. p. 0
Where the paper says it

First, we introduce Semap, a new open benchmark dataset comprising 1,439 manually annotated patches designed to reflect the variety of historical map documents. Second, we present a segmentation framework that combines procedural data synthesis with multiscale integration to improve robustness and transferability.

The Semap training dataset, comprising 1,439 manually annotated map samples, and 12,122 synthetically generated samples are openly available and released with this paper. p. 2
Where the paper says it

This diversity is made possible by the Aggregated Database on the History of Cartography (ADHOC), a dataset containing a balanced sample of 99,715 digitized maps from 16 heritage collections in Europe and the United States. The Semantic Segmentation Map Dataset we present here, abbreviated Semap, consists of 1,439 manually annotated map samples.

References

[1] E. Grabska-Szwagrzyk, M. Jakiel, W. Keeton, J. Kozak, T. Kuemmerle, K. Onoszko, K. Ostafin, M. Shahbandeh, P Szubert, A Szwagierczak, J Szwagrzyk 13043 doi:10.1111/conl.13043

[2] C Jiao M Heitzler L Hurni A fast and effective deep learning approach for road extraction from historical maps by automatically generating training data with symbol reconstruction 2022 102980 doi:10.1016/j.jag.2022.102980

[3] G Liu J Li P Nie Tracking the history of urban expansion in Guangzhou (China) during 1665–2017: Evidence from historical maps and remote sensing images 2021 105773 doi:10.16/j.landusepol.2021.105773

[4] K McDonough Maps as Data in Computational Humanities: Debates in Digital Humanities University of Minnesota Press 2024

[5] J H Uhl S Leyk Y-Y Chiang W Duan C A Knoblock Extracting human settlement footprint from historical topographic map series using context-based machine learning 2017 1–6 doi:10.1049/cp.2017.0144

[6] S A Oliveira I di Lenardo B Tourenc F Kaplan A deep learning approach to Cadastral Computing in Digital Humanities Conference 2019 URL https://dev.clariah.nl/files/dh2019/boa/0691.html

[7] O Ronneberger P Fischer T Brox U-net: Convolutional networks for biomedical image segmentation Lecture Notes in Computer Science volume 9351 Springer 2015 p. 234–241 doi:10.1007/978-3-319-24574-4 28

[8] K He X Zhang S Ren J Sun Deep Residual Learning for Image Recognition 2015 doi:10.48550/arXiv.1512.03385

[9] R Petitpierre Neural networks for semantic segmentation of historical city maps Cross-cultural performance and the impact of figurative diversity Master’s thesis EPFL 2020 doi:10.13140/RG.2.2.10973.64484

[10] M Heitzler L Hurni Extracting Buildings from Historical Maps With Convolutional Neural Networks in 1st Swiss Workshop on Machine Learning for Environmental and Geosciences MLEG 2019 2019 URL https://www.research-collection. p. 0

Where the paper says it

Additionally, relatively few annotated data are available, which constitutes a challenge for supervised computer vision. Consequently, the majority of research projects focus on large, visually uniform datasets.

ethz.ch/handle/20.500.11850/371976

[11] M Heitzler L Hurni Cartographic reconstruction of building footprints from historical maps A study on the Swiss Siegfried map 24 2020 442–461 doi:10.1111/tgis.12610

[58] R Petitpierre Historical City Maps Semantic Segmentation Dataset 2025 URL https://doi.org/zenodo.5497934

[70] R Petitpierre F Kaplan I di Lenardo Generic Semantic Segmentation of Historical Maps in Proceedings of the Conference on Computational Humanities Research 2021 volume 2989 CEUR 2021 URL http://ceur-ws.org/Vol-2989/long paper27. p. 0

Where the paper says it

The results indicate that segmentation performance remains largely stable across map collections, scales, geographic regions, and publication contexts. By proposing benchmark datasets and methods for the generic segmentation of historical maps, this work opens the way to integrating the long tail of cartographic archives to historical geographic studies.

pdf

[71] J Kim Z Li Y Lin M Namgung L Jang Y-Y Chiang The mapKurator System A Complete Pipeline for Extracting and Linking Text from Historical Maps 2023 doi:10.48550/arXiv.2306.17059

[72] R Petitpierre D Gomez Donoso B Kriesel Semantic Segmentation Map Dataset Semap 2025 doi:10.5281/zenodo.

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Procedural data synthesis for training synthetic images can approximate their visual appearance by applying graphical processes like plain color (e.g., Figure 3a, 3k), dotted patterns (e.g., Figure 3e, 3l), hatchings (e.g., Figure 3h, 3i), waterlines (e.g., Figure 3d), texture masks extracted from Semap, and icon sprites [63], e.g., Figure 3l. This allows the AI system to be trained on vast amounts of diverse map data that are not available through manual annotation alone.

  2. Multiscale inference strategy improves recognition of large objects spanning several patches by applying inference at two image scales and resolutions: first at the original resolution and then at half that resolution. This enables consensus predictions at a reduced computational cost, owing to the decreased spatial resolution to enhance segmentation quality for large features.

  3. The model can achieve state-of-the-art performance on diverse map collections by employing a diversity-driven approach, as the results show that diversity of training data, when paired with suitable architectures, is not an obstacle but a catalyst for robust learning. This makes the system collection agnostic and allows it to generalize across different map styles and geographic contexts.

  4. The AI system can be validated for cross-cultural genericity by fitting an ordinary least squares (OLS) model against metadata variables, confirming that segmentation performance is largely consistent across tested metadata classes, thus detecting no major systemic bias of failure mode.

  5. The system can utilize a new training dataset, Semap, which includes 1439 manually annotated samples plus 12122 synthetically generated samples to provide a robust foundation for training semantic segmentation models.

Abstract

Historical map collections are highly diverse in style, scale, and geographic focus, often consisting of many single-sheet documents. Yet most work in map recognition focuses on specialist models tailored to homogeneous map series. In contrast, this article aims to develop generalizable semantic segmentation models and a shared class ontology. We introduce Semap, a new open benchmark dataset comprising 1,439 manually annotated patches designed to reflect the variety of historical map documents. We also evaluate a segmentation workflow that combines procedural data synthesis with multiscale integration. Under the harmonized benchmarks considered here, this workflow attains the strongest performance among the evaluated approaches and viably learns from heterogeneous map data. The results indicate that segmentation performance remains largely stable across map collections, scales, geographic regions, and publication contexts. By providing benchmark data, a shared ontology, and an evaluation of generic segmentation across heterogeneous maps, this work contributes toward integrating the long tail of cartographic archives into historical geographic studies.

Sources

Related papers