Adapting a Foundation Model for Lunar Surface Height Estimation
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: We're looking at the paper: "Adapting a Foundation Model for Lunar Surface Height Estimation".
Title and authors: Tom: So we're talking about this paper today, "Adapting a Foundation Model for Lunar Surface Height Estimation." It’s about using these huge models, like Depth Anything V2 or DAV2, and making them work better for estimating how high things are on the Moon.
Jane: Right. The main idea here is that digital elevation models, or DEMs—those are maps of height—are super important for understanding the lunar surface because they give you that precise height information <ref:2609.02448#pg1>.
Tom: Exactly. And as the European Space Agency plans future landings, they need a really precise way to estimate heights for tricky terrain where landing approaches could be dangerous <ref:2609.02448#pg1>. So what this paper is doing is trying to get that estimation method much better than just using the base model on its own.
Lu: Basically, they're taking a known deep learning model, DAV2, and fine-tuning it specifically with data from Shape from Shading or SPG—those are traditional methods for getting DEMs from images <ref:2609.02448#pg2>. They’re trying to bridge that gap between the general knowledge the AI has and the specific look of lunar terrain <ref:2609.02448#pg1>.
Meng: Okay, so before we get into how they tuned it, what's the actual problem they are trying to solve? Is it just making a prediction slightly better, or is there a bigger issue with how these models handle this kind of data?
Jane: Well, the paper points out that just applying foundation models directly to remote sensing tasks often doesn't give good results because there’s this big gap between what those models were trained on and what they have to do now <ref:2609.02448#pg2>. They argue that just comparing the zero-shot model against other methods isn't fair because you haven't adapted it to this specific lunar domain yet <ref:2609.02448#pg1>.
Tom: That makes sense. So the core of their work is this fine-tuning strategy they introduce, and they use a technique called LoRA, which stands for low-rank adaptation <ref:2609.02448#pg3>.
Lu: They inject new learnable parameters into the Transformer encoder using LoRA with a rank of eight, so that's the specific setting they used <ref:2609.02448#pg3>. They also selectively unfrozen parts of the decoder network—specifically three out of four RefineNet blocks and the output head—to keep things balanced parameter-wise <ref:2609.02448#pg3>.
Meng: eight million parameters for that adaptation sounds like a reasonable trade-off, but what's guiding this tuning process? What loss functions are they using to make sure it actually gets better?
Jane: They use a hybrid loss function called Ltotal, which is made up of three parts: alpha times the Berhu loss, beta times the gm loss, and gamma times the norm loss <ref:2609.02448#pg2>. These losses are designed to guide the fine-tuning process in different ways.
Title and authors: Tom: Let's break down those losses for our listeners. The first one, LBerhu, is defined as this ratio between a prediction and the ground truth that includes some terms involving tau and r squared <ref:2609.02448#pg2>. It’s focused on getting the basic depth accuracy right across different scales.
Lu: That Berhu loss seems to be about matching the depth predictions against the actual ground truth, incorporating a term that depends on tau and r squared for every patch <ref:2609.02448#pg2>. It’s a way to penalize errors based on that structure.
Meng: Then there's Lgm, which deals with the residual gradient of the prediction relative to the ground truth, and they are incorporating downscale operations at four different scales—K equals four <ref:2609.02448#pg2>. That sounds like they’re trying to enforce consistency across those different resolution levels.
Jane: And finally, Lnorm measures the accuracy of the surface normal by calculating one minus the norm of both the predicted and ground truth surface normals <ref:2609.02448#pg2>. So they're not just looking at height, but also making sure the shape of that lunar surface is correct too.
Tom: So to summarize, they’re using this three-part hybrid loss function to guide the fine-tuning via LoRA on the ViT-L variant of DAV2 <ref:2609.02448#pg3>. The goal is to create a more reliable relative height estimator <ref:2609.02448#pg1>.
Lu: And they claim this approach significantly improves performance compared to the zero-shot model, effectively transforming DAV2 into a reliable relative depth estimator of the lunar surface <ref:2609.02448#pg1>.
Meng: Let's look at the numbers for a minute. What does this mean in practical terms for someone who has to deploy this on a real system? Is it fast enough or stable enough?
Jane: The quantitative results on the test set show that DEM-DAV2 achieves higher metrics compared to DAV2 <ref:2609.02448#pg1>. Specifically, Table one shows that DEM-DAV2 has a mean mean absolute error of four point seven one meters and a root mean square error of five point seven six meters <ref:2609.02448#pg1>.
Tom: That’s a big jump from the zero-shot DAV2, which had a mean absolute error of eleven point six four meters and an root mean square error of fourteen point one three meters <ref:2609.02448#pg1>. That’s a substantial reduction in error, especially for hazardous terrain analysis.
Lu: This improvement confirms what they were seeing qualitatively, showing that fine-tuning foundation models for remote sensing tasks is necessary because of that domain gap <ref:2609.02448#pg1>. It validates the idea of injecting specific domain knowledge into a general model <ref:2609.02448#pg3>.
Meng: So, if I’m running this in production, the implication is that we can trust the relative height estimates more for hazard localization because the error bars are much smaller now <ref:2609.02448#pg1>. But what about deployment challenges? Can this run on a standard CPU without massive computational overhead?
Jane: The authors note some limitations they have to admit, though. One limitation is that the model can't be used for real-time DEM estimation on a CPU <ref:2609.02448#pg1>. Also, they don't have auxiliary global DEMs with absolute height information available for this work <ref:2609.02448#pg1>.
Title and authors: Tom: So the system is great for high-precision relative estimation on a GPU setup, but we can’t rely on it for super low-latency CPU deployment right now <ref:2609.02448#pg1>. And that lack of absolute height data means we still need something else to anchor those heights to the real world <ref:2609.02448#pg1>.
Lu: Looking ahead, they plan to incorporate this DEM-DAV2 as an auxiliary model for crater detection <ref:2609.02448#pg1>. That suggests they see it not just as a height estimator but also a useful tool for other lunar mapping tasks <ref:2609.02448#pg1>.
Meng: That makes sense; using the height data to detect features like craters is a good way to test its utility beyond just measuring elevation <ref:2609.02448#pg1>. It shows the model has generalized well enough for other specific applications.
Jane: So, wrapping up on this paper, they’ve successfully taken DAV2 and fine-tuned it using SPG data and a hybrid loss function to create a reliable relative height estimator <ref:2609.02448#pg1>. This means we have a much more accurate tool for hazard localization on the Moon than we had before <ref:2609.02448#pg1>.
Tom: Exactly. The improvement from an error of eleven point six four meters down to four point seven one meters is pretty substantial when you're talking about precise landing approaches <ref:2609.02448#pg1>. It’s a clear demonstration of how domain adaptation works in practice <ref:2609.02448#pg1>.
Lu: The methodology, using LoRA and those three specific loss functions—Berhu, gm, and norm—is the mechanism that drives this performance gain <ref:2609.02448#pg3>. It’s a concrete way to inject the necessary lunar surface knowledge into the transformer architecture <ref:2609.02448#pg3>.
Meng: For deployment, what does this mean for our pipeline? Does this suggest we should start fine-tuning other foundation models using similar domain-specific loss functions rather than just relying on zero-shot transfers?
Jane: It suggests that for tasks with a huge domain gap, like moving from general vision to lunar topography, you really need that targeted fine-tuning approach <ref:2609.02448#pg1>. It proves that simply feeding the model more data isn't enough; you have to guide it with specific loss functions <ref:2609.02448#pg2>.
Tom: Yeah, it’s about showing that the mechanics of how you train a model matter just as much as the size of the pre-trained weights <ref:2609.02448#pg3>. The concrete numbers on MAE and RMSE are what really sell this result to anyone in engineering <ref:2609.02448#pg1>.
Lu: And for my research, it confirms that the transformer architecture, when modified with LoRA, is very effective at learning these specific surface relationships from limited domain data <ref:2609.02448#pg3>. It shows that small parameter adjustments can yield big results in specialized scenarios <ref:2609.02448#pg1>.
Meng: So, for me, the main thing is that this gives us a baseline for how much performance we can expect when we do this kind of specific fine-tuning on our own models instead of just hoping the general pre-training carries us through <ref:2609.02448#pg1>.
Title and authors: Jane: Ultimately, the paper, "Adapting a Foundation Model for Lunar Surface Height Estimation," shows that with targeted fine-tuning, we can make foundation models capable of providing precise height information for hazardous lunar terrain <ref:2609.02448#pg1>. It’s a practical step toward making autonomous lunar missions safer <ref:2609.02448#pg1>.
Tom: It is a solid result, showing that we can take something like DAV2 and make it perform much better on the Moon than it could out of the box <ref:2609.02448#pg1>. The methodology, especially those three loss functions, gives us a blueprint for how to handle these domain shifts in remote sensing AI <ref:2609.02448#pg3>.
Lu: We need to keep looking at how they plan to use this DEM-DAV2 as an auxiliary model for crater detection because that opens up a whole new area of research <ref:2609.02448#pg1>. It connects height estimation directly to feature extraction for other tasks <ref:2609.02448#pg1>.
Meng: And from a production standpoint, knowing this level of accuracy for relative depth estimation is key because it allows us to build better hazard detection algorithms <ref:2609.02448#pg1>. We need these reliable metrics when we are deploying actual systems <ref:2609.02448#pg1>.
Jane: So, to wrap up on the paper "Adapting a Foundation Model for Lunar Surface Height Estimation," they’ve shown that fine-tuning a model like DAV2 with SPG data and this hybrid loss function yields significantly lower error metrics for lunar surface height estimation <ref:2609.02448#pg1>. This gives us a much more reliable tool for hazard localization on the Moon <ref:2609.02448#pg1>.
Tom: It’s a strong performance boost, and it shows that domain adaptation is a necessary technique when you’re dealing with such distinct remote sensing environments <ref:2609.02448#pg3>. The work provides concrete numbers, like the mean absolute error of four point seven one meters compared to eleven point six four meters <ref:2609.02448#pg1>.
Lu: This research suggests that modifying existing transformer architectures with low-rank adaptation and carefully constructed hybrid loss functions is a viable path for making foundation models useful in specialized areas like lunar surface mapping <ref:2609.02448#pg3>. It’s about showing how to guide the model effectively when the data distribution is very different from its training set <ref:2609.02448#pg1>.
Meng: We need to keep testing if this approach scales well when we move beyond just these specific DEM datasets and try to apply it across other planetary surfaces <ref:2609.02448#pg1>. The lack of absolute height data is the main caveat for real-world deployment right now <ref:2609.02448#pg1>.
Jane: So, that’s what we have on this paper, "Adapting a Foundation Model for Lunar Surface Height Estimation." It gives us a much more reliable relative depth estimator for lunar surfaces through targeted fine-tuning and hybrid loss functions <ref:2609.02448#pg1>. We’ll be looking at how they use it for crater detection next time <ref:2609.02448#pg1>.
The paper's summary: Tom: So, we're looking at this paper "Adapting a Foundation Model for Lunar Surface Height Estimation," and basically, they’ve taken a big model called Depth Anything V2 and fine-tuned it using data from Shape from Shading to make it a much more reliable height estimator for the Moon.
Jane: Right. They’re trying to solve that problem where general AI models don't work well on specific remote sensing tasks because of that big gap between what they were trained on and what they need to do now.
Lu: The core idea is domain adaptation, using SPG derived Digital Elevation Model data to teach the model how lunar terrain looks in terms of height <ref:2609.02448#pg2>.
Meng: And the authors are using a hybrid loss function called Ltotal, which mixes three different types of errors—Berhu loss, gm loss, and norm loss—to guide this training process <ref:2609.02448#pg2>.
Tom: Yeah, they're not just relying on one metric; they’re looking at the height accuracy from the Berhu loss, checking the residual gradients with the gm loss, and even verifying surface normals with the norm loss <ref:2609.02448#pg2>.
Jane: The results are pretty compelling. They found that this DEM-DAV2 model is significantly better than just using the zero-shot DAV2 model on a test set <ref:2609.02448#pg1>.
Lu: Specifically, they report a mean absolute error of four point seven one meters and a root mean square error of five point seven six meters for DEM-DAV2, compared to eleven point six four meters and fourteen point one three meters for the zero-shot DAV2 <ref:2609.02448#pg1>.
Meng: That’s a big reduction in error, especially when you think about landing approaches where precision is everything <ref:2609.02448#pg1>. But there are caveats on the paper, right?
Jane: They do mention two main things they can't do. First, this method isn't ready for real-time DEM estimation on a standard CPU <ref:2609.02448#pg1>. And second, they don't have any global Digital Elevation Models with absolute height information available for this work <ref:2609.02448#pg1>.
Tom: So what that means for us in the field is that we can build a much more reliable relative height estimator on a powerful GPU setup <ref:2609.02448#pg1>. It’s great for hazard localization where you need to know the height difference between two points on the surface <ref:2609.02448#pg1>.
Lu: It proves that modifying existing transformer architectures with low-rank adaptation and carefully constructed hybrid loss functions is a viable way to inject lunar domain knowledge into general foundation models <ref:2609.02448#pg3>.
Meng: I mean, that confirms the idea that targeted fine-tuning, rather than just relying on zero-shot transfers, is necessary when you're dealing with such distinct remote sensing environments <ref:2609.02448#pg1>.
Jane: So, it gives us a blueprint for how to guide models effectively when the data distribution is very different from what they were originally trained on <ref:2609.02448#pg1>.
Tom: Exactly. The concrete numbers on the error reduction show that this isn't just theoretical stuff; it actually improves performance substantially for a real application like lunar surface hazard mapping <ref:2609.02448#pg1>.
Lu: And they’re already looking ahead, planning to use this DEM-DAV2 model as an auxiliary tool for crater detection, which suggests they see it as more than just a height estimator <ref:2609.02448#pg1>.
Meng: Using the height data to detect features like craters is useful because it tests the model’s generalization across different types of surface geometry <ref:2609.02448#pg1>.
Jane: So, this paper sets a strong baseline for how we can make these foundation models useful in specialized areas like lunar surface mapping <ref:2609.02448#pg3>.
Tom: We'll keep an eye on how they use it for crater detection because that could open up a whole new area of research <ref:2609.02448#pg1>.
The paper's improvements: Tom: So, we’re talking about how this paper suggests improving the system they built for lunar height estimation <ref:2609.02448#pg1>. They aren't just stopping at getting a better prediction; they’re proposing specific ways to make the model more robust.
Jane: Right. The improvements focus on how they construct that training signal, using three specific loss functions instead of just one standard error <ref:2609.02448#pg2>.
Lu: They are suggesting this hybrid loss function—the Berhu loss, the gm loss, and the norm loss—is key because it ensures accuracy in depth, consistency across different scales with that four scales K equals four for the gm loss, and correct surface normals with that norm part <ref:2609.02448#pg2>.
Meng: So what does that actually mean for deployment? It means they are building a training signal that checks depth accuracy, residual gradient deviation across those scales, and the actual shape of the surface <ref:2609.02448#pg1>.
Tom: I like that part about checking the residual gradient deviation; it sounds like they’re forcing the model to be consistent not just in one spot, but across different levels of detail <ref:2609.02448#pg3>. That’s a solid mechanic for better generalization.
Jane: And that consistency is important because if the model gets confused at one scale, it can lead to big errors when you try to estimate something bigger or smaller <ref:2609.02448#pg1>. It’s about making sure the prediction makes sense everywhere on the map.
Lu: Exactly. The way they’re defining that loss function is what changes things; it forces the model to learn better representations for those specific geometric relationships on a planetary surface <ref:2609.02448#pg3>.
Meng: From a production standpoint, if we could distill that into a smaller set of constraints, maybe we could speed up inference without losing that accuracy <ref:2609.02448#pg1>. What’s the cost of running all three loss calculations at once?
Jane: Well, they are using LoRA with rank eight to inject the new parameters into the Transformer encoder, which helps keep the parameter count manageable for adaptation <ref:2609.02448#pg3>. That keeps things efficient during training <ref:2609.02448#pg1>.
Tom: So they’re balancing high accuracy with parameter efficiency by only tweaking those specific layers of the model, which is smart engineering <ref:2609.02448#pg3>.
Lu: It shows that you don't always need to retrain the entire giant foundation model; sometimes small, targeted adjustments via techniques like LoRA are enough to unlock better performance for a specific task <ref:2609.02448#pg1>.
Meng: That’s what I want to hear. It means we don't need massive compute resources just to adapt these models for specific planetary conditions; we can focus our training efforts on those crucial loss terms <ref:2609.02448#pg3>.
Jane: It really changes how you think about adapting general AI for specialized science applications, showing that the method matters as much as the size of the model itself <ref:2609.02448#pg1>.
Tom: So, moving forward, we should look at how this hybrid loss function approach works when we try to apply it to other planetary surfaces like Mars or even Earth topography <ref:2609.02448#pg1>.
Conclusion: Tom: So, to wrap up on "Adapting a Foundation Model for Lunar Surface Height Estimation," this paper shows that by fine-tuning models like DAV2 with specific data and three different loss functions, we can get a much more reliable relative height estimator for lunar surfaces <ref:2609.02448#pg1>.
Jane: It’s a solid result, proving that targeted fine-tuning is necessary when you're dealing with such distinct remote sensing environments <ref:2609.02448#pg1>.
Lu: The methodology, especially using LoRA to adjust the encoder and that hybrid loss function for depth, consistency across scales, and surface normals, gives us a blueprint for how to guide models effectively <ref:2609.02448#pg3>.
Meng: I mean, it shows that small parameter adjustments can yield big results in specialized scenarios like this lunar mapping task <ref:2609.02448#pg1>.
Tom: Exactly, and those concrete numbers on error reduction, from eleven point six four meters down to four point seven one meters, really sell the idea that this is a practical improvement for hazard localization <ref:2609.02448#pg1>.
Jane: It’s a practical step toward making autonomous lunar missions safer by giving us a much more reliable tool for relative depth estimation <ref:2609.02448#pg1>.
Lu: We need to keep looking at how they plan to use this DEM-DAV2 model as an auxiliary tool for crater detection because that opens up a whole new area of research <ref:2609.02448#pg1>.
Meng: Using the height data to detect features like craters is useful because it tests the model’s generalization across different types of surface geometry <ref:2609.02448#pg1>.
Tom: So, this paper demonstrates that you can take something like DAV2 and make it perform much better on the Moon than it could out of the box <ref:2609.02448#pg1>.
Jane: It’s a clear demonstration of how domain adaptation works in practice <ref:2609.02448#pg1>.
Lu: The research confirms that modifying existing transformer architectures with low-rank adaptation and carefully constructed hybrid loss functions is a viable path for making foundation models useful in specialized areas like lunar surface mapping <ref:2609.02448#pg3>.
Meng: We’ll need to keep testing if this approach scales well when we move beyond just these specific DEM datasets and try to apply it across other planetary surfaces <ref:2609.02448#pg1>.
Tom: The concrete numbers on MAE and RMSE are what really show the value here for anyone in engineering <ref:2609.02448#pg1>.
Jane: It’s a strong performance boost, and it shows that domain adaptation is a necessary technique when you’re dealing with such distinct remote sensing environments <ref:2609.02448#pg3>.
Lu: We should also keep watching their next steps regarding the auxiliary model for crater detection because that connects height estimation directly to feature extraction for other tasks <ref:2609.02448#pg1>.
Meng: And from a production standpoint, knowing this level of accuracy for relative depth estimation is key because it allows us to build better hazard detection algorithms <ref:2609.02448#pg1>.
Tom: So, the paper "Adapting a Foundation Model for Lunar Surface Height Estimation" provides a blueprint for how to handle these domain shifts in remote sensing AI <ref:2609.02448#pg3>.
University of Technology of Troyes · European Space Agency · Hochschule Darmstadt · Technische Hochschule Würzburg-Schweinfurt
cs.CV
Submitted: 2026-09-02
Updated: 2026-11-18
DOI: 10.1109/LGRS.2026.3754087
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
The gist: Digital elevation models (DEMs) can provide accurate height information, making it invaluable for analyzing the lunar surface <ref:2609.02448#pg2> As the European Space Agency (ESA) prepares for…
Key concepts
- Depth Anything V2 (DAV2)
- This is a pre-trained foundation model used for relative depth estimation. The researchers adapted this existing model to handle the specific challenges of estimating heights on the lunar surface, which requires specialized training data.
- LoRA
- Low-Rank Adaptation is a parameter-efficient fine-tuning technique. Instead of retraining the entire large model, LoRA injects small, trainable matrices into specific parts of the Transformer encoder. This allows for significant performance gains with far fewer computational resources and parameters.
- Hybrid Loss Function (Ltotal)
- This combined loss function guides the training process using three distinct goals: LBerhu focuses on depth accuracy, Lgm ensures the residual gradients match across different scales, and Lnorm verifies the accuracy of surface normals. This multi-faceted approach leads to a more robust and accurate final estimation.
Terminology
Summary
Digital elevation models (DEMs) can provide accurate height information, making it invaluable for analyzing the lunar surface <ref:2609. p. 002448#pg2> As the European Space Agency (ESA) prepares for future lunar missions that aim to land on the Moon, a precise method for height estimation will be essential for hazardous terrain that could endanger the landing approach <ref:2609. p. 002448#pg2>. Our goal is to address this issue by developing a relative lunar surface height estimator that can provide additional information for hazard localization <ref:2609. p. 002448#pg2>. In this letter, we present a methodology that builds on the well-known zero-shot relative depth estimation model Depth Anything V2 (DAV2) <ref:2609. p. 002448#pg2>. Our results demonstrate a significant improvement in performance compared to the zero-shot model, effectively transforming DAV2 into a reliable relative depth estimator of the lunar surface <ref:2609. p. 002448#pg2>.
Pruning redundant reasoning tokens
The paper introduces a fine-tuning strategy for DAV2 using publicly available SPG-derived DEM data to create a more reliable relative height estimator <ref:2609.02448#pg2>. This approach is necessary because naively applying foundation models to remote sensing tasks does not yield good results due to a significant domain gap between pre-training and downstream tasks <ref:2609. p. 1 p. 102448#pg2>. The authors argue that comparing the zero-shot model directly with existing methods is limited because adaptations to the target domain are missing <ref:2609. p. 002448#pg2>.
How the training signal is built
The methodology involves fine-tuning DAV2 by injecting new learnable parameters into the Transformer-based encoder using low-rank adaptation (LoRA) with a rank of r = 8 <ref:2609.02448#pg2>. The decoder network is also selectively unfrozen, keeping the first layers frozen and unfreezing three of four RefineNet blocks and the output head to balance parameter counts <ref:2609. p. 202448#pg2>. A hybrid loss function Ltotal is employed, consisting of three partial losses: Ltotal = αLBerhu + βLgm + γLnorm <ref:2609. p. 202448#pg2>.
Where the gains come from
The training signal is constructed using three specific loss functions to guide the fine-tuning process <ref:2609.02448#pg2>.
-
LBerhu is defined as LBerhu(d∗, ˆd∗) = 1/HW Sum over i=1 to HW ri 1if ri≤τ + r 2i + τ 2/2τ for the prediction and ground truth <ref:2609. p. 2 p. 202448#pg2>.
-
Lgm accounts for the deviation of the residual gradient of the prediction with respect to its corresponding ground truth, incorporating downscale operations at four scales K=4 <ref:2609. p. 3 p. 302448#pg2>.
-
Lnorm measures the accuracy of the normal to the surface by calculating 1 - nd∗i ndˆ∗i <ref:2609. p. 3 p. 302448#pg2>.
Quantitative evaluation
The quantitative results on the test set show that DEM-DAV2 yields higher metrics on the test dataset compared to DAV2 <ref:2609.02448#pg2>. Specifically, Table 1 shows that DEM-DAV2 has a mean MAE of 4. p. 5 p. 571 m and an RMSE of 5. p. 3 p. 376 m, whereas DAV2 has a mean MAE of 11. p. 364 m and an RMSE of 14. p. 3 p. 313 m <ref:2609. p. 0 p. 002448#pg2>. This improvement confirms the qualitative observations, highlighting the importance of fine-tuning foundation models for remote sensing tasks given the domain gap <ref:2609. p. 402448#pg2>.
Conclusion and Future Work
The authors conclude that they have transformed DAV2 into a reliable relative height estimator of the lunar surface through this fine-tuning strategy <ref:2609.02448#pg2>. Limitations noted include the inability to use the model for real-time DEM estimation on a CPU and the lack of auxiliary global DEMs with absolute height information <ref:2609. p. 502448#pg2>. Future work plans to incorporate DEM-DAV2 as an auxiliary model for crater detection <ref:2609. p. 502448#pg2>.
References
[1] European Space Agency. Argonaut: Europe’s lunar lander programme, 2025. p. 6 URL: https://www. p. 6esa.int/Science Exploration/Human and Robotic Exploration/Exploration/Argonaut Europe's lunar lander programme <ref:2609.02448#pg2>
[2] Atal Tewari, Vinay Verma, Pradeep Srivastava, Vikrant Jain, and Nitin Khanna. Automated Crater detection from Co-registered optical images and elevation maps using deep learning <ref:2609. p. 602448#pg2>
[3] Chen Zou, Jialong Lai, Yanshuang Liu, Feifei Cui, Yi Xu, and Le Qiao. Small lunar crater identification and age estimation in chang’e-5 landing area based on improved faster r-cnn <ref:2609. p. 602448#pg2>
[4] Patrick Bauer, Marius Schwinning, Florian Renk, Andreas Weinmann, and Hichem Snoussi. Vision-Language Model for Accurate Crater Detection <ref:2609. p. 602448#pg2>
[5] Atal Tewari, Kumar Prateek, Amrita Singh, and Nitin Khanna. Deep learning based systems for crater detection: A review <ref:2609. p. 602448#pg2>
[6] M. S. Robinson, S. p. 6 M. Brylow, M. Tschimmel, D. p. 6 Humm, S. J. Lawrence, P. p. 6 C., Thomas, B. p. 7, Denevi, E., Bowman-Cisneros, J. p. 6, Zerr, M., Ravine, M., Caplinger (and others). p. 6 Lunar Reconnaissance Orbiter Camera (LROC) Instrument Overview <ref:2609. p. 602448#pg2>
[7] Oleg Alexandrov and Ross A. Beyer. Multiview shape-from-shading for planetary images <ref:2609. p. 602448#pg2>
[8] M.R. Henriksen, M. p. 6R., Manheim, K. p. 6N., Burns, P., Seymour, E. p. 6J., Speyerer, A. p. 6, Deran, A.K., Boyd, E., HowingtonKraus, M. p. 6R., Rosiek, B.A., Archinal (and others). p. 6 Extracting accurate and precise topography from lroc narrow angle camera stereo observations <ref:2609. p. 602448#pg2>
[9] Robert V. Wagner, Megan R. p. 6 Henriksen, Madeleine R. p. 6 Manheim, Heather M. p. 6, Meyer, Maria E. p. 6, Banks, Erick Malaret (and others). p. 6 Where is that crater? p. 0 best practices for obtaining accurate coordinates from lroc nac data <ref:2609. p. 602448#pg2>
[10] Yang Liu, Yexin Wang, Kaichang Di, Man Peng, Wenhui Wan, and Zhaoqin Liu. A generative adversarial network for pixel-scale lunar dem generation from high-resolution monocular imagery and low-resolution dem <ref:2609. p. 602448#pg2>
[11] Jonathan T. Barron and Jitendra Malik. p. 6 High-frequency shape and albedo from shading using natural image statistics <ref:2609. p. 602448#pg2>
[12] René Ranftl, Katrin Lasinger, David Hafner, Konrad Schindler, and Vladlen Koltun. Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer <ref:2609. p. 602448#pg2>
[13] Bingxin Ke, Anton Obukhov, Shengyu Huang, Nando Metzger, Rodrigo Caye Daudt, and Konrad Schindler. Repurposing diffusion-based image generators for monocular depth estimation <ref:2609. p. 602448#pg2>
[14] Lihe Yang, Bingyi Kang, Zilong Huang, Xiaogang Xu, Jiashi Feng, and Hengshuang Zhao. Depth anything: Unleashing the power of large-scale unlabeled data <ref:2609. p. 602448#pg2>
[15] Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao, Xiaogang Xu, Jiashi Feng, and Hengshuang Zhao. Depth anything v2 <ref:2609. p. 002448#pg2>
[16] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. p. 7 Attention is all you need <ref:2609. p. 702448#pg2>
[17] Danfeng Hong, Chenyu Li, Xuyang Li, Gustau Camps-Valls, and Jocelyn Chanussot. Foundation models in remote sensing: Evolving from unimodality to multimodality <ref:2609. p. 702448#pg2>
[18] Muying Luo, Tao Zhang, Shiqing Wei, and Shunping Ji. Sam-rsis: Progressively adapting sam with box prompting to remote sensing image instance segmentation <ref:2609. p. 702448#pg2>
[19] Tianhao Chen, Yexin Wang, Jing Nan, Chenxu Zhao, Biao Wang, Bin Xie, Wai-Chung Liu, Kaichang Di (and others). A generative adversarial network for pixel-scale lunar dem generation from single high-resolution image and low-resolution dem based on terrain self-similarity constraint <ref:2609. p. 702448#pg2>
[20] Yu Tao, Siting Xiong, Susan J. Conway, Jan-Peter Muller, Anthony Guimpier, Peter Fawdon, Nicolas Thomas (and others). p. 7 Rapid single image-based dtm estimation from exomars tgo cassis images using generative adversarial u-nets <ref:2609. p. 702448#pg2>
[21] Hao Chen, Xuanyu Hu, Philipp Gläser, Haifeng Xiao, Zhen Ye, Hanyue Zhang, Xiaohua Tong (and others). Cnn-based large area pixel-resolution topography retrieval from single-view lroc nac images constrained with sldem <ref:2609. p. 702448#pg2>
[22] Hao Chen, Philipp Gläser, Xuanyu Hu, Konrad Willner, Yongjie Zheng, Friedrich Damme, Lorenzo Bruzzone (and others). Elunardtmnet: Efficient reconstruction of high-resolution lunar dtm from single-view orbiter images <ref:2609. p. 702448#pg2>
[23] Riccardo La Grassa, Cristina Re, Adriano Tullo, Ignazio Gallo, and Gabriele Cremonese. Transformer-driven monocular high-resolution dtm generation on mars via multimodal integration of cassis imagery and mola altimetry <ref:2609. p. 702448#pg2>
[24] Rafał Osadnik, Pablo Gómez, Eleni Bohacek, Rickbir Bahia. Mcted: A machine-learning-ready dataset for digital elevation model generation from mars imagery <ref:2609. p. 702448#pg2>
[25] Michael K. Barker, Erwan M. p. 7 Mazarico, Gregory A. p. 7 Neumann, Maria T. p. 7, Zuber, Jun’ichi Haruyama, and David E. p. 7 Smith. A new lunar digital elevation model from the lunar orbiter laser altimeter and selene terrain camera <ref:2609. p. 702448#pg2>
[26] Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy V., Marc Szafraniec (and others). p. 7 Dinov2: Learning robust visual features without supervision <ref:2609. p. 702448#pg2>
[27] René Ranftl, Alexey Bochkovskiy, and Vladlen Koltun. Vision transformers for dense prediction <ref:2609. p. 702448#pg2>
[28] Guosheng Lin, Anton Milan, Chunhua Shen, and Ian D. Reid. Refinenet: Multi-path refinement networks for high-resolution semantic segmentation <ref:2609. p. 702448#pg2>
[29] Ke Xian, Chunhua Shen, ZHIGUO CAO, Hao Lu, Yang Xiao, Ruibo Li, and Zhenbo Luo. Monocular relative depth perception with web stereo data supervision <ref:2609. p. 702448#pg2>
[30] Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang (and others). p. 7 LoRA: Low-Rank Adaptation of Large Language Models <ref:2609. p. 702448#pg2>
[31] Laurent Zwald and Sophie Lambert-Lacroix. The berhu penalty and the grouped effect <ref:2609. p. 702448#pg2>
[32] Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization <ref:2609. p. 802448#pg2>
--- Page 1 ---
ADAPTING A FOUNDATION MODEL FOR LUNAR SURFACE HEIGHT ESTIMATION Patrick Bauer University of Technology of Troyes Hochschule Darmstadt patrick.bauer@utt.fr Marius Schwinning European Space Agency marius. p. 0schwinning@esa. p. 0int Melanie Siegel Hochschule Darmstadt melanie. p. 0siegel@h-da. p. 0de Andreas Weinmann Technische Hochschule Würzburg-Schweinfurt andreas. p. 0weinmann@thws. p. 0de Hichem Snoussi University of Technology of Troyes hichem. p. 0snoussi@utt. p. 0fr
--- Page 2 ---
Adapting a Foundation Model for Lunar Surface Height Estimation
Adapting a Foundation Model for Lunar Surface Height Estimation <ref:2609.02448#pg2> This paper introduces a fine-tuning strategy for DAV2 using publicly available SPG-derived DEM data to create a more reliable relative height estimator <ref:2609. p. 002448#pg2>. This approach is necessary because naively applying foundation models to remote sensing tasks does not yield good results due to a significant domain gap between pre-training and downstream tasks <ref:2609.02448#pg2>.
The methodology involves fine-tuning DAV2 by injecting new learnable parameters into the Transformer-based encoder with LoRA, applying it to the query and value matrices with rank r = 8 <ref:2609.02448#pg2>. The CNN-based decoder network is also selectively unfrozen, keeping the first layers of the decoder frozen and unfreezing three of four RefineNet blocks and the output head <ref:2609. p. 202448#pg2>.
The training signal is constructed using a hybrid loss function Ltotal = αLBerhu + βLgm + γLnorm <ref:2609.02448#pg2>. The three partial losses are defined as LBerhu, Lgm, and Lnorm <ref:2609. p. 202448#pg2>.
** LBerhu is defined as LBerhu(d∗, ˆd∗) = 1/HW Sum over i=1 to HW ri 1if ri≤τ + r 2i + τ 2/2τ for the prediction and ground truth <ref:2609.02448#pg2>.**
** Lgm accounts for the deviation of the residual gradient of the prediction with respect to its corresponding ground truth, incorporating downscale operations at four scales K=4 <ref:2609.02448#pg2>.**
** Lnorm measures the accuracy of the normal to the surface by calculating 1 - nd∗i ndˆ∗i <ref:2609.02448#pg2>.**
The quantitative results on the test set show that DEM-DAV2 yields higher metrics on the test dataset compared to DAV2 <ref:2609.02448#pg2>. Table 1 shows that DEM-DAV2 has a mean MAE of 4.71 m and an RMSE of 5.76 m, while DAV2 has a mean MAE of 11. p. 364 m and an RMSE of 14.13 m <ref:2609.02448#pg2>.
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Adapt Depth Anything V2 using publicly available Shape from Shading derived Digital Elevation Model data to create a lunar surface height estimator that provides additional information for hazard localization. This allows the model to become
a reliable relative depth estimator of the lunar surface.
-
Implement a fine-tuning strategy using LoRA to update the Transformer-based encoder with rank r=8, while selectively unfreezing only 3 of 4 RefineNet blocks and the output head in the DPT decoder. This reduces parameter updates to approximately 8 million, making it more parameter efficient for remote sensing tasks.
-
Employ a hybrid loss function Ltotal = alphaLBerhu + betaLgm + gammaLnorm to train DEM-DAV2, incorporating Berhu loss (for depth accuracy), multiscale gradient matching loss (for residual gradient deviation), and a normal surface loss (for surface normal accuracy). This comprehensive approach ensures high performance on the lunar test set.
-
The improved system can perform relative height estimation for hazard localization by comparing its output to ground truth elevation maps, as shown by the quantitative results where DEM-DAV2 yielded significantly lower MAE and RMSE compared to the zero-shot DAV2 model.
Sources
- Deep Learning based Systems for Crater Detection: A Review
- Depth Anything V2
- MCTED: A Machine-Learning-Ready Dataset for Digital Elevation Model Generation From Mars Imagery
- DINOv2: Learning Robust Visual Features without Supervision
- LoRA: Low-Rank Adaptation of Large Language Models
Related papers
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs
- From Formulas to Protocols: A Compositional View of Binary Target Segmentation Metrics
- Traffic Sign Recognition in Autonomous Driving: Dataset, Benchmark, and Field Experiment