When Emotions Matter: Speech-Based Emotion Detection in Capstone Project Retrospective Meetings while Working Hybrid
Name
3786580.3786987.pdf
Size
1016.33 KB
Format
Adobe PDF
Checksum (MD5)
3f440480b5222f37e1affe7cbdf48800
Author(s)
Awan, Wardah Naeem
Paasivaara, Maria
Gloor, Peter A.
Date Issued
July 13, 2026
Publisher
Association for Computing Machinery
Citation
Wardah Naeem Awan, Maria Paasivaara, and Peter A. Gloor. 2026. When Emotions Matter: Speech-Based Emotion Detection in Capstone Project Retrospective Meetings while Working Hybrid. In Proceedings of the IEEE/ACM 48th International Conference on Software Engineering (ICSE-SEET '26). Association for Computing Machinery, New York, NY, USA, 244–255.
Version
Final published version
Abstract
Hybrid capstone projects present unique emotional and collaboration challenges for software engineering students working across in-person and remote settings. Emotions significantly influence how students communicate, coordinate, and evaluate their team performance, yet they are often underexplored in software engineering education. This study investigates the emotional dynamics of student teams during Scrum retrospective meetings using speech-based emotion recognition. We analyzed audio from 24 retrospectives across four student teams using WavLM-Large, fine-tuned on the IEMOCAP dataset, to detect expressed emotions. These results were correlated with self-assessed team performance data collected from post-sprint surveys. Our findings reveal that (1) frustration and excitement as the most frequent non-neutral emotions; (2) emotional expression varied significantly across meeting formats, with in-person meetings fostering a wider emotional range due to higher social presence, hybrid meetings displaying mixed emotional dynamics caused by the split between remote and in-person participants, and online meetings being more emotionally restrained due to limited non-verbal cues; and (3) a strong negative correlation between frustration and perceived team performance, while calmer, neutral-toned discussions were positively associated with higher self-assessed ratings. These findings highlight the importance of emotional awareness in team-based learning and offer recommendations for creating emotionally supportive, modality-aware learning environments in software engineering education.
Description
ICSE-SEET ’26, Rio de Janeiro, Brazil
Terms of Use
Creative Commons Attribution
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/3786580.3786987
