EditPPT: Structured Execution and Evaluation for Reliable Slide Editing
summary
The gist
The gist The EDITPPT framework reframes slide editing as a constrained tool-selection problem executed via shape-level operations through the native PowerPoint COM interface, which addresses
In short
EditPPT reframes slide editing as a constrained tool-selection problem using PowerPoint's native COM interface. It uses a multi-agent framework to decompose requests into shape-level operations, ensuring precision and preservation. This approach outperforms open code generation by limiting the LLM's action space, leading to high success rates and better original deck preservation.
Key concepts
- Shape-Level Operations
- Instead of editing pixels, the system focuses on modifying specific PowerPoint objects like text boxes or charts using their unique IDs. This method ensures that changes are targeted precisely at the intended element without accidentally altering surrounding content or layout, which is crucial for reliable editing.
- PowerPoint COM Interface
- This is a built-in programming interface that allows external software, like the EDITPPT framework, to directly control and manipulate Microsoft PowerPoint applications. It acts as a shared bridge for parsing the presentation structure and executing deterministic edits directly within the application's object model.
- Dual-Modal Validation
- The system checks edits using two different methods: one structural validator verifies that the requested changes were made correctly according to the parsed data, while a Visual Language Model (VLM) validator checks for visual quality issues like overlaps or clipping. Separating these checks makes the evaluation much more robust.
- Constrained Action Space
- The framework limits each specialist agent to only a small subset of predefined, deterministic tools (e.g., 37 tools). This constraint prevents the LLM from generating arbitrary code or making broad, risky changes, forcing it to operate within a predictable and safe set of allowed actions.
Terminology used across episodes
This episode discusses
- EditPPT: Structured Execution and Evaluation for Reliable Slide Editing · Paper Radio
- DECKBench: Benchmarking Multi-Agent Frameworks for Academic Slide Generation and Editing
- Talk to Your Slides: High-Efficiency Slide Editing via Language-Driven Structured Data Manipulation
- VLM-SlideEval: Evaluating VLMs on Structured Comprehension and Perturbation Sensitivity in PPT
- OmniParser for Pure Vision Based GUI Agent
- PPTArena: A Benchmark for PowerPoint Editing
- AeSlides: Incentivizing Aesthetic Layout in LLM-Based Slide Generation via Verifiable Rewards
- Gorilla: Large Language Model Connected with Massive APIs
- Deep Research: A Systematic Survey
- AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
- PresentAgent-2: Towards Generalist Multimodal Presentation Agents
- OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
- Auto-Slides: An Interactive Multi-Agent System for Creating and Customizing Research Presentations
- SlideTailor: Personalized Presentation Slide Generation for Scientific Papers
- DeepPresenter: Environment-Grounded Reflection for Agentic Presentation Generation
The paper
EditPPT: Structured Execution and Evaluation for Reliable Slide Editing · Read on arXiv
Jiheon Kim, Kyudan Jung, Jaegul Choo
KAIST AI
Reliable slide editing requires precise modifications to intended objects while preserving the rest of the presentation. We argue that slide editing is a problem of structured, constrained modification rather than open-ended code generation. Despite the complexity of real presentations, editing requests can largely be decomposed into the objects to change, the operations to apply, and the state to preserve. This perspective guides both evaluation and execution. For evaluation, we introduce DeckEdit-Bench, 183 editing tasks on 28 human-authored decks whose target and preserved objects are annotated at the shape level, so that intended and unintended changes are scored mostly by deterministic rules. For execution, we present EditPPT, a multi-agent framework that resolves targets before editing, restricts each specialist to a subset of 37 predefined tools, and validates each edit for instruction fulfillment and preservation, correcting or rolling back failed ones. Across five backbone models, EditPPT reaches 66.7-74.9% Task Success while keeping Preservation above 97%. Even with an open 27B model and no task-specific fine-tuning, it approaches Claude Code with Sonnet 5 in Task Success while better preserving the original deck. These results suggest that constraining how edits are executed, not only model scale, makes slide editing more reliable.
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: We're looking at the paper: "EditPPT: Structured Execution and Evaluation for Reliable Slide Editing".
Jane: Here's the gist of the paper. The gist The EDITPPT framework reframes slide editing as a constrained tool-selection problem executed via shape-level operations through the native PowerPoint COM interface, which addresses cascading errors in long decks by narrowing the LLM action space and preserving application-resolved structure.
Tom: How it works EDITPPT processes an editing request through a five-stage pipeline (Figure 2) where it "(i) parses the relevant slides into structured representations of native PowerPoint objects, augmented with selective visual metadata, (ii) decomposes the instruction into a per-slide task list, (iii) dispatches each task to a specialist agent, (iv) executes deterministic shape-level operations through the PowerPoint COM interface, and (v) validates the result using complementary structural and visual validators before either accepting the edit or triggering recovery" The core mechanism involves using the running PowerPoint application as a shared interface for both parsing and editing, following evidence that "object-model-based slide manipulation can be more efficient and style-preserving than pixel-level".
Jane: The system employs a COM-based parser that produces a JSON object enumerating native PowerPoint objects and their properties, including "object type, geometry, text and font attributes, table and chart contents, image metadata, and slide-level elements".
Tom: This representation reduces input size significantly compared to raw XML by removing "package-level XML redundancy while preserving editable object state".
Paper summary: Tom: So, EDITPPT proposes a multi-agent framework that uses the native PowerPoint COM interface to do the actual editing. They claim this approach narrows the LLM action space while keeping application-resolved structure intact.
Jane: But how does it manage that complexity? If we're talking about long decks, where errors tend to cascade, what's stopping it from just making a mess?
Tom: The core mechanism involves parsing the request into structured representations of native PowerPoint objects and then using a planner to break that down into per-slide subtasks. Each task goes to a specialist agent who only uses a small subset of predefined tools.
Lu: They use this structure-first representation, which they call Augmented Slide Representation, where they produce a JSON object listing every shape ID and its properties before the agents even start working on anything.
Meng: I wonder about that parsing step. If we have to convert everything into a JSON object of native PowerPoint properties, isn't that going to be slow or create too much overhead for a fast editing loop?
Tom: They address that by using a COM-based parser that produces this JSON, which they say removes "package-level XML redundancy while preserving editable object state." It’s designed to be smaller than raw XML because it keeps the actual state of the objects.
Jane: And then they have this multi-agent dispatcher routing tasks based on object type, and each agent is tied to specific tools like text editing or chart editing. That sounds like a very specialized team of workers.
Lalam: I see how that specialization helps control the output. The agents are constrained to tools that are deterministic at the shape level, which should keep things predictable when they execute the changes via COM.
Tom: And they don't stop there with just execution; they have a dual-modal validation system after every edit. They separate instruction verification from visual quality assessment for more robust checking.
Jane: That sounds smart because you could have one agent follow the text instructions perfectly, and another module check if the visual layout still looks right, like making sure things aren't overlapping.
Lu: That separation is what they emphasize because replacing that dual-modal validator with just one Vision Language Model judge caused instruction following to collapse by over thirty-seven points and object preservation by nearly thirty-two points <ref:2608.20381#pg3>.
Conclusion: Tom: So, looking at the paper "EditPPT: Structured Execution and Evaluation for Reliable Slide Editing", the authors are showing that constraining *how* edits are executed, not just making the AI model bigger, actually makes slide editing more reliable.
Jane: What does that mean in simple terms for someone who isn't deep in AI engineering? What's the big picture implication here?
Tom: It means we can move away from relying on open-ended code generation for presentation editing and toward a system where the process is highly structured, using specific tools for specific parts of the deck.
Lu: The implication is that if you define the problem as constrained modification—targets, operations, preservation—you get better results than just letting an LLM wander around trying to write the whole deck from scratch.
Meng: For production use, this suggests that instead of a massive general-purpose model doing everything, we could deploy these specialized agents with their fixed toolsets for high-fidelity editing tasks.
Jane: So it’s about reliability through structure and constraint rather than just raw model size? That makes sense when you think about the cascading errors they were fighting against.
Tom: Exactly. The paper introduces EDITPPT and DECKEDITBENCH, showing that by using a COM-based parser and constrained tool execution, they mitigate length-induced error cascades in practical slide editing.
More episodes
- The day in conversation for 2026-10-23
- Daily Summary for 2026-10-23
- 2606.09846-CANVAS: Captioning Art with Narrative Visual-Audio AI Systems
- 2606.10890-Optimal Post-Training Quantization Scales and Where to Find Them
- 2606.11232-Is LLM's Moral Decision Compositional?
- 2606.14867-Evaluating the Robustness of Proof Autoformalization in Lean 4
- 2606.15507-Frame-Conditioned Moral Computation in LLaMA 3.1-8B-Instruct: An Exploratory Mechanistic Interpretability Audit of Ethical Reasoning
- 2606.15555-Service-Induced Congestion in Memory-Constrained LLM Serving
- 2606.24075-End-to-End Radar and Communication Modulation Recognition with Neuromorphic Computing
- 2606.26728-Scientific discovery as meta-optimization: a combinatorial optimization case study