VoCa: Designing Speech-Canvas Interaction for Voice-Based Conversational Agents

cs.HC, cs.AI

Submitted: 2026-10-03

Updated: 2026-10-03

Comments: 22 pages, 11 figures, 5 tables

Code: https://github.com/microsoft/Huabu

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Sources

• Conversations in Space: Non-Linear LLM Interaction in Everyday Use
• Proactive Agentic Whiteboards: Enhancing Diagrammatic Learning
• Who's That Player?: Externalizing Query Interpretation in Spoken XR Sports Interaction
• Speech-Synchronized Whiteboard Generation via VLM-Driven Structured Drawing Representations
• When Drawing Is Not Enough: Exploring Spontaneous Speech with Sketch for Intent Alignment in Multimodal LLMs
• A Multimodal GUI Architecture for Interfacing with LLM-Based Conversational Assistants

Related papers

• Calibrating LLM Explanations to Human Decisions with Reinforcement Learning
• EduGage: A Multimodal Dataset and Benchmark for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning
• EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution
• HAGI++: Head-Assisted Gaze Imputation and Generation
• Explanation User Interfaces: A Systematic Literature Review
• Hybrid Cinematography: Previsualizing and Managing Hallucination Risk in Generative Video Reshooting