Comparing Human Role-Players and LLM-Simulated Clients in Online Counselling Training: An Analysis of Counselling Patterns

arXiv:2610.40563 · cs.AI, cs.CL · Submitted 2026-10-29 · Read on arXiv

cs.AI, cs.CL

Submitted: 2026-10-29

Updated: 2026-10-29

Comments: Published at EDM 2025 (18th International Conference on Educational Data Mining), short paper. 7 pages

Journal ref: Proceedings of the 18th International Conference on Educational Data Mining (EDM 2025), short papers

DOI: 10.5281/zenodo.15870260

License: http://creativecommons.org/licenses/by/4.0/

The gist: This study investigates the capabilities of Large Language Models to simulate counselling clients in educational role-plays in comparison to human role-players.

Abstract

This study investigates the capabilities of Large Language Models to simulate counselling clients in educational role-plays in comparison to human role-players. Initially, we recorded role-playing sessions, where novice counsellors interacted with human peers acting as clients, followed by role-plays between humans and clients simulated by Mistrals Mixtral 8x7b using 4-bit quantization. These interactions were analysed with a counselling communication pattern system at sentence level. We investigated two key questions: (1) to what extent LLM-generated responses replicate authentic conversational dynamics and (2) whether counsellors' communication behaviour differs when interacting with human versus LLM-simulated clients. The findings highlight both similarities and differences in the application of counselling patterns across scenarios, showing the potential of LLM-based role-playing exercises to enhance counselling competencies and to identify areas for further refinement in virtual client simulations.

Related papers