KIT | KIT-Bibliothek | Impressum | Datenschutz

Speech Emotion Recognition Beyond Benchmarks: Robustness, Efficiency, and Evaluation for Real-World Deployment

Beyer, Dominik; Mazura, Florian; Köder, Julian ; Stork, Wilhelm 1
1 Institut für Technik der Informationsverarbeitung (ITIV), Karlsruher Institut für Technologie (KIT)

Abstract:

Robust Speech Emotion Recognition (SER) for edge applications requires evidence beyond within-corpus accuracy. We propose a three-tier protocol separating speaker, corpus, and deployment-proxy shifts rather than a new classifier. It compares Wav2Vec 2.0 Base, WavLM Base, Whisper Base, Whisper Tiny, and ReDimNet-B2 on a five-corpus composite training set. Models are selected on speaker-independent validation with unseen source-corpus speakers, then tested on unseen IEMOCAP. Whisper Tiny is also tested on 108 smartphone recordings by 9 non-professional speakers. Speaker-independent UAR ranges from 0.752 to 0.786 but falls to 0.475 to 0.531 on IEMOCAP. Whisper Tiny and ReDimNet-B2 remain close to larger Base models despite smaller encoders, while the smartphone test reveals class-dependent failures for happy and angry speech. The protocol structures stress testing for compact SER models and shows parameter count alone is an insufficient proxy for robustness or deployability.


Download
Originalveröffentlichung
DOI: 10.1109/ICTIIA70925.2026.11717155
Zugehörige Institution(en) am KIT Institut für Technik der Informationsverarbeitung (ITIV)
Publikationstyp Proceedingsbeitrag
Publikationsmonat/-jahr 09.2026
Sprache Englisch
Identifikator ISBN: 979-8-3195-4644-9
KITopen-ID: 1000199050
Erschienen in 2026 3rd International Conference on Technology Innovation and Its Applications (ICTIIA)
Veranstaltung 3rd International Conference on Technology Innovation and its Applications (ICTIIA 2026), Surabaya, Indonesien, 17.09.2026 – 19.09.2026
Verlag Institute of Electrical and Electronics Engineers (IEEE)
Seiten 1–6
Externe Relationen Siehe auch
Schlagwörter speech emotion recognition, cross-domain learning, low-resource deployment, human-computer interaction
Nachgewiesen in Scopus
OpenAlex
KIT – Die Universität in der Helmholtz-Gemeinschaft
KITopen Landing Page