HARBOR: Heading Analysis and Reconstruction from Behavioral Observation and Radar

summary

Video file (mp4)

The gist

The gist The HARBOR method introduces a complete pipeline for transforming a single SAR image into predictive motion information without requiring any auxiliary data source at inference time.

In short

HARBOR transforms a single SAR image into predictive vessel motion maps without needing external data during operation. It achieves this by automatically detecting, classifying, and estimating heading from the image alone. By using offline AIS data for calibration, it provides short-term probabilistic trajectory projections in scenarios where real-time tracking is impossible.

Key concepts

Preprocessing
This step cleans the raw SAR image to enhance features for detection. It involves radiometric calibration, reducing speckle noise through multilooking, and using a Lee Sigma filter for further noise reduction. Regions too small (under 60 pixels) are discarded as they are likely just noise.
Size Classification
Detected vessels are grouped into Small, Medium, or Large categories based on the size of their bounding box in pixels. This pixel-based grouping is mapped to physical vessel lengths derived from offline AIS records (Small < 50m, Medium 50-200m, Large >= 200m) to provide a practical classification.
Trajectory Projection
This generates a probabilistic heatmap showing future positions oriented along the inferred heading. It uses calibrated motion parameters to convert vessel speed into pixel displacement per minute and calculates a projection radius ($r_{max}$) for the desired time horizon, concentrating probability around the central axis.

Terminology used across episodes

This episode discusses

The paper

HARBOR: Heading Analysis and Reconstruction from Behavioral Observation and Radar · Read on arXiv

Joao P. A. Dantas, Paulo F. Silva Filho, Jelton A. Cunha, Gabriel Dietzsch

Institute for Advanced Studies

Maritime situational awareness often relies on Automatic Identification System (AIS) transmissions to track vessel movements. However, in operational or conflict scenarios, these data may be unavailable due to signal loss, deliberate deactivation, or intentional spoofing. In such conditions, synthetic aperture radar (SAR) imagery becomes a critical sensing alternative for wide-area maritime monitoring, despite providing only static scene snapshots. This work introduces HARBOR (Heading Analysis and Reconstruction from Behavioral Observation and Radar), a complete pipeline for transforming a single SAR image into predictive motion information without requiring any auxiliary data source at inference time. The method begins with SAR image preprocessing to enhance and segment vessel candidates, followed by automatic detection, size-based classification, and heading estimation using skeleton geometry and local intensity patterns. AIS data are used exclusively during an offline calibration phase to derive vessel-type-dependent motion parameters, which are then applied to generate probabilistic heatmaps of candidate future vessel positions. A case study using real COSMO-SkyMed SAR imagery demonstrates the pipeline on a maritime scene in southern Brazil, showing its ability to extract motion tendencies and generate probabilistic projections of vessel positions in data-denied environments.

DOI: 10.2514/6.2026-4783

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "HARBOR: Heading Analysis and Reconstruction from Behavioral Observation and Radar".

Jane: Here's the gist of the paper. The gist The HARBOR method introduces a complete pipeline for transforming a single SAR image into predictive motion information without requiring any auxiliary data source at inference time.

Tom: Method Overview HARBOR is designed to address the challenge of estimating a vessel’s trajectory from a single image frame by separating motion modeling from image analysis, where AIS data are used exclusively during an offline calibration phase to derive motion parameters per vessel type.

Jane: The proposed approach performs automatic preprocessing to enhance relevant features and segment potential vessel targets, followed by detection, classification, and heading estimation based on geometric and intensity information.

Tom: Pipeline Steps The methodology consists of a sequence of steps to transform a static SAR image into a predictive map of future vessel positions.

Title and authors: Jane: Let's talk about what this paper actually does, looking at the title and authors of "HARBOR: Heading Analysis and Reconstruction from Behavioral Observation and Radar."

Tom: The authors are coming from a place where maritime situational awareness often relies on Automatic Identification System transmissions to track vessel movements. They know that in operational or conflict scenarios, those AIS data might be unavailable because of signal loss, deliberate deactivation, or intentional spoofing.

Lu: That’s the context they’re setting up; they are addressing the fact that synthetic aperture radar imagery becomes a critical sensing alternative for wide-area maritime monitoring even when you only get a static scene snapshot.

Meng: So if I'm thinking about deploying this, what’s the main promise here? Is it that we can get better tracking than just using raw SAR intensity?

Tom: The promise of HARBOR is that it introduces this complete pipeline for transforming a single SAR image into predictive motion information without requiring any auxiliary data source at inference time.

Jane: So, instead of needing a stream of images or some external tracking system to predict where a ship will go, you take one picture and get the prediction right there.

Lu: They start with SAR image preprocessing to enhance and segment vessel candidates, which then leads into automatic detection, size-based classification, and heading estimation using skeleton geometry and local intensity patterns.

Lalam: Essentially, they’re building a system that uses the geometry of the detected objects in the image to infer their direction of travel.

The paper's summary: Tom: So to summarize what this paper is proposing, HARBOR aims to solve that problem by turning a static SAR image into predictive maps of vessel motion.

Jane: It separates the motion modeling from the image analysis, meaning they process the picture first and then use AIS data only offline to build those motion parameters for different vessel types.

Lu: They have this five main component pipeline: preprocessing, vessel detection, size classification, motion estimation, and trajectory projection.

Meng: I’m curious about that size classification part; how are they grouping the vessels if they don't have any real-time physical measurements? Does it just rely on the pixel area in the image?

Tom: Yes, they do. The paper describes a size classification step where detected vessels are grouped into three categories based on their bounding box area in pixels: Small, Medium, and Large.

Jane: And then they link those pixel sizes to physical vessel lengths using an offline calibration step where AIS records are used to assign categories under a complementary scheme, which means small is less than fifty meters and large is two hundred meters or more.

Lalam: They use this size information to create motion parameters per vessel type during that offline calibration phase, which then feeds into the trajectory projection model.

The paper's improvements: Tom: The authors point out several improvements they made over prior work, like extending the idea of using Monte Carlo simulations applied to SAR detections but without estimating heading direction.

Jane: They also specifically mention how HARBOR extends this by adding a complete pipeline covering preprocessing, automatic detection, size classification, and morphological heading estimation.

Lu: A key improvement is that they use AIS data exclusively during an offline calibration step to build motion parameters per vessel type, which successfully removes the need for any external data source during operation.

Meng: That’s interesting because it directly addresses the problem of needing real-time auxiliary data, which is a major hurdle in many deployment scenarios where signals are unreliable.

Tom: They also note that SAR image analysis can draw on richer signal representations beyond just intensity, mentioning features based on entropy and anisotropy in polarimetric SAR.

Jane: And for the trajectory projection model, they generate a probabilistic heatmap oriented along the inferred heading using those calibrated motion parameters to create direction-aware position estimates from a single SAR image.

Conclusion: Tom: To wrap up, the paper "HARBOR: Heading Analysis and Reconstruction from Behavioral Observation and Radar" shows that by combining single-snapshot SAR inference with AIS-derived motion statistics, the system produces probability maps that show likely vessel movement within a short time window.

Jane: This capability suggests a significant shift for maritime surveillance because it shows the method’s potential use for maritime surveillance scenarios with limited sensing opportunities, even when data is denied.

Lu: The authors acknowledge some limitations, though they note that the size classification relies on pixel-based area thresholds which might need recalibration for different sensors, and it also relies exclusively on single-polarization intensity data.

Meng: From a deployment standpoint, the limitation is that the calibration data used came from just one day along the United States coastline while they tested it in southern Brazil, so generalizing those motion parameters across different regions is still an open question.

Lalam: The paper concludes that by combining single-snapshot SAR inference with AIS-derived motion statistics, HARBOR produces probability maps that show likely vessel movement within a short time window.

Tom: It’s a solid piece of work because it shows how you can use what you already have—a static image—to make a prediction about the future.

Jane: This is a big step forward for any system that needs to operate in data-denied maritime environments, proving that motion estimation doesn't always require continuous tracking data.

More episodes

← Home