Souffleur: A Glanceable Display for Mobile Voice Conversations

arXiv:2611.08443 · cs.HC · Submitted 2026-11-05 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Computer Science. The day in computer science: software, systems and theory on arXiv.

Tom: I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "Souffleur: A Glanceable Display for Mobile Voice Conversations".

Jane: Here's the gist of the paper. Voice conversations with Artificial Intelligence (AI) increasingly happen on the phone, in moments where the screen can get no more than a glance Souffleur, a voice-first thinking partner whose display folds the conversation into a stack of topics, each with the decision reached on it, following six design goals derived from formative work This work finds no reliable difference between a glanceable topic display and a conventional chat transcript in how easily participants followed or resumed short voice conversations Pruning redundant reasoning tokens The paper investigates the design of "Souffleur," a mobile-first, speech-driven, glanceable display intended to help users continue their reasoning from where they left off after an interruption The core problem addressed is that in voice conversations, the last messages may not convey key points of the conversation when resuming after a context switch The study implemented Souffleur and evaluated it in a between-subjects study with 48 participants compared with a conventional chat transcript How the training signal is built The design goals for Souffleur were derived from four months of autobiographical use and research through design, as well as sessions with external participants Six specific design goals were established to guide the interface development These goals included Glance, don’t read; Show the suspended goal; Keep everything in its place; Overview first, the current words in view; Show the state, not only the content; and Make the AI’s part visible Where the gains come from The study compared Souffleur with a conventional chat display across various task types and sources in a 2x2x2 between-subjects design The results showed no reliable difference between the two displays regarding ease of following, resumption lag, or recall The study found that participants rated the conversation as easy to follow and resumed almost always on the topic they had left Evaluation findings The evaluation revealed that for RQ1, Ease of following, Effort, and Looking at the screen, there was no reliable difference between Chat and Souffleur For RQ2, Resumption lag, the median was 2.9 s with Chat and 3.

Title and authors: Tom: Let's look at who wrote this paper. The authors are Anton Wolter from Aarhus University in Denmark, William Benjamin who is an independent researcher in the USA, and Niklas Elmqvist also from Aarhus University. They’re coming from a mix of academic research and practical work on these kinds of interfaces.

Jane: So we have researchers focused on the human-centered side of computing alongside people building things outside the academic bubble. It suggests this isn't just theoretical, but something grounded in real user needs for mobile use.

Lu: The setup itself is interesting because they start by identifying a gap between what we currently have—the standard chat transcript—and what users actually need when they are interrupted during voice interactions.

Meng: I wonder if their background helps them bridge that gap between academic concepts and actual deployment on a mobile phone, since that’s where the real friction happens for me.

Lalam: They come from places that study how people work through problems aloud, which is the foundation of this kind of interaction they're designing.

The paper's summary: Tom: The paper sets up a comparison between Souffleur and a conventional chat transcript to see how users follow and resume conversations when there’s an interruption. They specifically asked three main questions about how the topic display affects following, effort, and what people actually take away from the conversation.

Jane: So they ran a study with forty-eight participants who did short voice conversations with an LLM agent on their phones, pausing midway to measure how fast and whether those users could pick up exactly where they left off.

Lu: The main finding they report is that there was no reliable difference between the topic stack display and the regular chat transcript in how easily people followed the conversation or in what it cost them in terms of effort or attention.

Meng: That's a bit of a surprise if it doesn't show a clear win for one over the other regarding basic comprehension, though I wonder if that lack of difference is because their conversations were too short.

Lalam: It suggests that for short voice conversations, the structure itself might not be the deciding factor in whether someone can keep up with what’s happening.

The paper's improvements: Tom: The authors then go on to suggest some specific design improvements they developed based on their research goals. They wanted to make the display more intuitive and provide clearer feedback, which led them to focus on making the AI’s part of the conversation very visible.

Jane: They proposed several things, like adding a glanceable stack that shows whether a topic is settled or still open, and making sure that even when you switch contexts, the current topic header stays anchored so you can resume easily later.

Lu: They also mentioned making decision lines on each topic to show what has been decided, like "Room four point one two, still open," which gives concrete status updates instead of just a vague header <ref:2611.08443#pg1,Room 4.12, still open>.

Meng: I’m interested in the part about color coding the AI's input—using orange for people and blue for the agent—that helps users track where their ideas came from versus where they were generated by the AI. That might be important when debugging model outputs.

Lalam: The idea of keeping a slot for every topic, even if it doesn't immediately get attention, ensures that the overall conversation structure remains stable and predictable for someone glancing in the periphery.

Conclusion: Tom: So to wrap up, the paper on "Souffleur: A Glanceable Display for Mobile Voice Conversations" found that for following and resuming short voice conversations, there was no reliable difference between using the new topic display and a plain chat transcript. The study also showed that participants almost always resumed on the topic they had left.

Jane: It seems the main implication is that in these quick, interrupted voice interactions, adding a fancy visual structure doesn't necessarily make it easier for users to keep up with the flow of ideas.

Lu: But there are still design goals they worked towards, like keeping everything in its place and making the AI’s part visible through color coding and state persistence across sessions. Those elements are key for building a more robust system overall.

Meng: From an engineering standpoint, if the core usability is similar to a transcript, maybe we should focus on what breaks at scale instead of just adding visual flair that doesn't change the human follow rate significantly.

Lalam: Ultimately, this work points toward how voice agents need persistent memory structures to handle interruptions effectively in a mobile setting. It’s about managing the context over time.

Aarhus University

cs.HC

Submitted: 2026-11-05

Updated: 2026-11-05

Code: https://github.com/vercel/next.js

License: http://creativecommons.org/licenses/by/4.0/

Importance score: 71/100

The gist: Voice conversations with Artificial Intelligence (AI) increasingly happen on the phone, in moments where the screen can get no more than a glance Souffleur…

Key concepts

Souffleur
A mobile-first, speech-driven display designed to fold a voice conversation into a stack of topics. It aims to help users quickly grasp the conversation's status and resume reasoning after an interruption without reading long transcripts.
Design Goals
Six specific goals derived from user research and autobiographical use that guided the interface development. These goals focused on making information glanceable, showing suspended goals, maintaining structure, providing overviews, showing state rather than just content, and making the AI's contributions visible.
Glanceable Topic Display
A display format where conversation information is condensed into short topic headlines. This allows users to quickly scan and understand the main points of a conversation without needing to read a full transcript, improving usability in voice interactions.

Terminology

Summary

Voice conversations with Artificial Intelligence (AI) increasingly happen on the phone, in moments where the screen can get no more than a glance Souffleur, a voice-first thinking partner whose display folds the conversation into a stack of topics, each with the decision reached on it, following six design goals derived from formative work This work finds no reliable difference between a glanceable topic display and a conventional chat transcript in how easily participants followed or resumed short voice conversations

Pruning redundant reasoning tokens

The paper investigates the design of Souffleur, a mobile-first, speech-driven, glanceable display intended to help users continue their reasoning from where they left off after an interruption The core problem addressed is that in voice conversations, the last messages may not convey key points of the conversation when resuming after a context switch The study implemented Souffleur and evaluated it in a between-subjects study with 48 participants compared with a conventional chat transcript

How the training signal is built

The design goals for Souffleur were derived from four months of autobiographical use and research through design, as well as sessions with external participants Six specific design goals were established to guide the interface development These goals included Glance, don’t read; Show the suspended goal; Keep everything in its place; Overview first, the current words in view; Show the state, not only the content; and Make the AI’s part visible

Where the gains come from

The study compared Souffleur with a conventional chat display across various task types and sources in a 2x2x2 between-subjects design The results showed no reliable difference between the two displays regarding ease of following, resumption lag, or recall The study found that participants rated the conversation as easy to follow and resumed almost always on the topic they had left

Evaluation findings

The evaluation revealed that for RQ1, Ease of following, Effort, and Looking at the screen, there was no reliable difference between Chat and Souffleur For RQ2, Resumption lag, the median was 2.9 s with Chat and 3. p. 0

Where the paper says it

Souffleur: A Glanceable Display for Mobile Voice Conversations ANTON WOLTER, Aarhus University, Denmark WILLIAM BENJAMIN, Independent Researcher, USA NIKLAS ELMQVIST, Aarhus University, Denmark You’re speaking… 24 min · 86 messages This chat has gotten really long. I can’t see everything at once anymore.

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Add a glanceable topic stack display to voice conversations that folds information into short topic headlines, marking whose words mostly rests on (person or agent) and whether it is settled or still open (DG5). This allows users to quickly grasp the conversation status without reading a full transcript.

  2. Implement state persistence by keeping the semantic anchor (the current topic header) visible across sessions, which has been observed to make unfinished ideas appear to revive unfinished ideas (Learning 3). This aids in cross-session resumption after interruptions.

  3. Design a display where each topic keeps its slot, meaning a topic that comes back leaves a gap (DG3), ensuring the conversation structure remains stable and predictable for users glancing at it in the periphery of vision.

  4. Introduce decision lines on each topic to show what has been decided, such as “Room 4.12, still open” (DG5). This provides concrete status updates that are critical for resuming a task after an interruption.

  5. Make the AI's part visible by using a color code, Orange for the person, blue for the agent, wherever words appear in the topic structure (DG6). This helps users track which ideas came from an AI and which they elaborated themselves.

Abstract

The speech capabilities of mobile devices have grown, but their displays still rely on a text-based chat. When resuming a voice chat after a context switch, the last messages may not convey the key points of the conversation. Autobiographical use and sessions with external participants led to design goals for a mobile-first, speech-driven, glanceable display that helps users continue their reasoning from where they left off. We implement these goals in Souffleur and evaluate it in a between-subjects study with 48 participants. Compared with a conventional chat transcript, we found no reliable difference in how easily participants followed and resumed short voice conversations, nor in effort, attention or recall, although Souffleur reduces the conversation to a few short phrases.

Sources

Related papers