Artifact Filtering versus Artifact-Compensated Training in JPEG to JPEG AI Recompression

arXiv:2611.13029 · eess.IV, cs.MM · Submitted 2026-11-09 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Electrical Engineering. The day in electrical engineering: signals, systems and the hardware that carries them.

Rosa: I'm Rosa.

Dev: And I'm Dev, here with Taro.

Rosa: We're looking at the paper: "Artifact Filtering versus Artifact-Compensated Training in JPEG to JPEG AI Recompression".

Dev: Here's the gist of the paper. In this paper, we consider the problem of recompression of images from JPEG to JPEG AI format and show that an artifact-compensated training approach can combine pre-filtering against target distortions with efficient compression without increasing processing time Problem Statement The direct recompression from JPEG to JPEG AI trained on uncompressed images results in the preservation of the JPEG image artifacts in the resulting JPEG AI image The two main challenges are that models trained on raw images process JPEG artifacts as part of the original image, and that these artifacts can be considered specific noise which affects compression efficiency Proposed Approaches The paper evaluates two main approaches to overcome these challenges.

Paper summary: Rosa: Looking at "Artifact Filtering versus Artifact-Compensated Training in JPEG to JPEG AI Recompression," we see that the authors are directly comparing two different strategies to handle image artifacts when moving from standard JPEG to the newer JPEG AI format.

Dev: The core finding is that the artifact-compensated training method wins because it achieves a significant reduction in those artifacts while keeping processing time exactly where it needs to be, without adding that twenty-nine times slowdown seen in the pre-filtering approach.

Rosa: So, for anyone working on image compression pipelines, this suggests that focusing on how the model learns from the distorted data itself is a better path than trying to clean up the input image before it even hits the compressor.

Dev: The authors highlight this potential combination of pre-filtering and efficient compression as a powerful capability for JPEG AI, which is something they claim shows its real potential in handling complex source coding stages.

Taro: It seems like the implication here is that we can build systems that are both artifact-aware and fast enough for real-time applications, provided we train them correctly on the right kind of data.

Rosa: So, while this paper doesn't solve every compression problem in existence, it points toward a better way to integrate distortion handling into the training process rather than treating it as an afterthought.

Conclusion: Rosa: So, this paper, titled "Artifact Filtering versus Artifact-Compensated Training in JPEG to JPEG AI Recompression," it’s basically comparing two ways to handle those ugly artifacts when you convert a standard JPEG image into the new JPEG AI format.

Dev: Right, they’re looking at how you can either clean up the input image before compression or train the model to handle those distortions directly.

Rosa: The main thing they show is that this approach of artifact-compensated training actually works better than just filtering the images first. It combines pre-filtering with efficient compression without slowing down your processing time much.

Dev: That’s significant because we usually have to choose between spending extra time cleaning the data or getting a faster, but potentially lower quality, compression speed.

Rosa: The authors found that training on distorted data lets the model learn how to fix those specific JPEG artifacts while still being pretty fast. It means you don't have to do a lot of extra work upfront.

Dev: So what does this mean practically for real-time systems? If we can get better artifact handling by just changing how we train, that opens up new possibilities for high-speed image pipelines where latency matters a lot.

Rosa: It points toward building models that are inherently more robust to the specific noise patterns of JPEG compression, which is a big step in making these AI formats more reliable.

Dev: Yeah, it suggests that future work should focus on scaling this up to handle even more complex distortions without sacrificing those real-time performance metrics. We’ll look at how this handles failure modes next.

Igor Podtsepko, Yuriy Kim, Karam Mahfod, Evgeny Belyaev, Kristian Kirs, Jianping Lin, Ilya Papiev

ITMO University, Russia · Huawei Technologies Co., Ltd.

eess.IV, cs.MM

Submitted: 2026-11-09

Updated: 2026-11-09

Comments: Preprint. Submitted to IEEE Multimedia on 21 February 2026. This is the author's draft version; it has not undergone peer review. 15 pages, 8 figures

Code: https://github.com/thangvubk/FEQE

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Importance score: 77/100

The gist: In this paper, we consider the problem of recompression of images from JPEG to JPEG AI format and show that an artifact-compensated training approach can combine pre-filtering against target…

Key concepts

JPEG to JPEG AI Recompression
This is the process of converting a standard JPEG image into the specialized JPEG AI format. The goal is to perform this conversion without introducing new visual defects or failing to remove existing artifacts present in the original JPEG file.
Artifact-Compensated Training
This training strategy involves teaching an AI model to handle specific distortions found in target images during its learning phase. By pre-filtering the input data against these known distortions, the model learns to effectively compensate for or ignore those artifacts during the final compression step.
Pre-filtering Against Target Distortions
This technique involves applying specific filters or modifications to the input JPEG images before they are fed into the AI model. These filters are designed to mimic or neutralize known distortions present in the desired JPEG AI output, helping the model focus on structural information rather than artifact noise.
Efficient Compression without Increased Processing Time
The proposed method aims to achieve high-quality artifact removal during compression while ensuring that the overall computational time remains low. This means the complex training and filtering steps are optimized so that the final recompression step is quick enough for practical use.

Terminology

Summary

In this paper, we consider the problem of recompression of images from JPEG to JPEG AI format and show that an artifact-compensated training approach can combine pre-filtering against target distortions with efficient compression without increasing processing time

Problem Statement

The direct recompression from JPEG to JPEG AI trained on uncompressed images results in the preservation of the JPEG image artifacts in the resulting JPEG AI image The two main challenges are that models trained on raw images process JPEG artifacts as part of the original image, and that these artifacts can be considered specific noise which affects compression efficiency

Proposed Approaches

The paper evaluates two main approaches to overcome these challenges.

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Artifact-Compensated Training for JPEG AI can combine pre-filtering against target distortions with efficient compression without increase in processing time, achieving a compressed file size reduction from 10.9% to 12.9% compared to direct recompression on uncompressed images.

  2. The proposed artifact-compensated training allows the JPEG AI model to be trained with the input image jointly filtered against JPEG compression artifacts and compressed, leading to results that are visually much closer to the original raw images than those from JPEG AI (RAW).

  3. The system can achieve a compression gain of up to 25% in BPP reduction while maintaining similar MS-SSIM performance when comparing FBCNN+JPEG AI (RAW) and JPEG AI (ACT).

Related papers