Sky Monitor AI: classifying night-sky conditions from an observatory all-sky camera with a CNN ensemble, label-free sky types and exact evidence maps
summary
The gist
Small and remotely operated observatories must decide every night whether the sky is clear enough to observe Abstract>.
In short
This study developed an end-to-end system to classify night sky conditions from an observatory camera using a CNN ensemble. The ensemble achieved 86.7% accuracy with minimal variation between nights, outperforming other methods. The system also discovered a 'wet-dome' class without labels and provides tools for generating evidence maps and cloud cover estimates.
Key concepts
- CNN Ensemble
- This involves combining the predictions of three different Convolutional Neural Networks (CNNs) to make a final decision. By averaging their results, the system becomes more robust against errors from any single model, leading to higher accuracy and less variation in performance across different observation nights.
- Label-Free Sky Type Discovery
- The researchers used clustering on embeddings from pre-trained CNNs to automatically find different sky types (like clear or cloudy) without needing pre-labeled data for those specific classes. This method successfully identified a new category, 'water droplets on the camera dome,' which was not present in the original training labels.
- Evidence Maps
- These maps are generated by analyzing how the final network makes its decision. They show exactly which parts of the sky image influenced the classification (e.g., specific regions indicating cloud cover). This provides a visual explanation for why a model chose a particular outcome, useful for operational understanding.
- Moonlight Sensitivity
- Moonlight is identified as the primary challenge in classifying sky conditions. The ensemble model demonstrated superior resilience to variations caused by moonlight compared to individual models or simpler statistical methods, making it more reliable when observing under varying lunar illumination.
Terminology used across episodes
This episode discusses
- Sky Monitor AI: classifying night-sky conditions from an observatory all-sky camera with a CNN ensemble, label-free sky types and exact evidence maps · Paper Radio
The paper
Sky Monitor AI: classifying night-sky conditions from an observatory all-sky camera with a CNN ensemble, label-free sky types and exact evidence maps · Read on arXiv
Muhammad Waqas
Department of Astronomy, Institut Teknologi Bandung
Transcript
Introduction to the show: ident: Astrophysics. The day in astrophysics: observations, models and what the data forces.
Vera: I'm Vera.
Jocelyn: And I'm Jocelyn, here with Subrahmanyan.
Vera: We're looking at the paper: "Sky Monitor AI".
Jocelyn: Here's the gist of the paper. Small and remotely operated observatories must decide every night whether the sky is clear enough to observe Abstract>.
Vera: The ensemble of three CNNs reaches 86.7 per cent accuracy with the smallest night-to-night scatter Conclusion>.
Jocelyn: Classification Pipeline and Model Performance The paper presents a complete pipeline that classifies frames of the auxiliary all-sky camera of the HigashiHiroshima Observatory as clear or cloudy Abstract>.
Vera: Hand-crafted sky statistics reach 77.1 per cent accuracy on six test nights, while a small convolutional neural network (CNN) trained from scratch reaches 84.3 per cent, and an ensemble of the small CNN and two ImageNet-pretrained ResNet-18 variants reaches 86.7 per cent (AUC 0.924) with the smallest night-to-night scatter Abstract>.
Paper summary: Vera: So we've been looking at this study called "Sky Monitor AI: classifying night-sky conditions from an observatory all-sky camera with a CNN ensemble, label-free sky types and exact evidence maps" which uses an ensemble of deep learning models to classify what’s in the night sky from a big all-sky camera.
Jocelyn: It’s a pretty comprehensive piece because they aren't just giving you a simple clear or cloudy answer; they're also producing these exact evidence maps and estimates for cloud cover.
Subrahmanyan: The authors used this approach to discover new classes of sky types without needing any pre-labeled data for those specific things, like finding frames with water droplets on the camera dome.
Vera: That’s significant because it shows how you can use unsupervised methods, like Gaussian mixture clustering on those AI embeddings, to find stuff that wasn't even in the initial labels.
Jocelyn: And they found a separate class for things like condensation or precipitation on the optics, which is operationally important for keeping equipment safe.
Subrahmanyan: From a cosmological view, it means we get a better way to filter out instrumental noise or localized atmospheric issues before we start looking at the actual astronomical signals.
Vera: The whole system runs as an open-source application that you can use on single frames or even live cameras, which is really democratizing how astronomers can process this kind of data.
Jocelyn: It also tells us that the ensemble method handles things like moonlight much better than any single model alone, which is a big win for those nights when the sky isn't perfectly dark.
Subrahmanyan: So what this implies for future work is using these models to generate preliminary classifications, giving you a starting point before you dive into more complex physical modeling of the light itself.
Conclusion: Vera: So we've seen this whole process laid out in "Sky Monitor AI," which is essentially using an ensemble of deep learning models to look at images from an all-sky camera and decide what's happening night skyward.
Jocelyn: The authors show that their combined approach hits eighty-six point seven per cent accuracy with a zero point nine two four AUC, while keeping the variation between nights really low.
Subrahmanyan: What’s interesting here is how they found those new sky types without any pre-labeled data, which means they could even identify frames with water droplets on the camera dome.
Vera: That’s significant because it proves you can use techniques like Gaussian mixture clustering on the AI embeddings to find things that weren't in the original labels.
Jocelyn: And they distinguished between different types of wet conditions, which is useful for keeping the equipment safe, not just knowing if it's cloudy or clear.
Subrahmanyan: From a cosmological standpoint, this means we have a better way to filter out localized atmospheric stuff before we try to model the actual light coming from deep space.
Vera: It’s an open-source application now, so anyone can use these exact evidence maps with old frames or even live cameras.
Jocelyn: That makes it a real resource for people trying to interpret data from remote observation sites.
Subrahmanyan: So, we've seen the results and the tool. But what this really means is that automated classification can be a strong first step in observational work, helping you sort through ambiguous data before you spend time on more detailed physical modeling of light itself.
More episodes
- 2607.17929-gevolution 2.0: GPU-accelerated relativistic N-body simulations for cosmology
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- 2509.02657-On the synergetic use of Ariel and JWST for exoplanet atmospheric science
- 2609.10042-Modelling Fourier filtering wavefront sensors for PSD-based methods: the AOPERA tool
- 2511.05639-Performance of the AstroPix Prototype Module for the Barrel Imaging Calorimeter at the ePIC Detector and in Space-Based Payloads
- 2610.19909-RPCA: a Resolved PSF reconstruction method for undersampled images
- 2512.03440-An Analysis of LIGO Glitches Using t-SNE During the First Part of the Fourth LIGO-Virgo-KAGRA Observing Run
- 2608.10284-Lunar Reflective Interferometry
- 2610.16633-Institutional broadening of the Japanese astronomy and astrophysics research community during 1996-2025