KIT | KIT-Bibliothek | Impressum | Datenschutz

Joint Transcription of Acoustic Guitar Strumming Directions and Chords

Murgul, Sebastian ORCID iD icon 1; Johannes Schimper 1; Heizmann, Michael 1
1 Institut für Industrielle Informationstechnik (IIIT), Karlsruher Institut für Technologie (KIT)

Abstract:

Automatic transcription of guitar strumming is an underrepresented and challenging task in Music Information Retrieval (MIR), particularly for extracting both strumming directions and chord progressions from audio signals. While existing methods show promise, their effectiveness is often hindered by limited datasets. In this work, we extend a multimodal approach to guitar strumming transcription by introducing a novel dataset and a deep learning-based transcription model. We collect 90 min of real-world guitar recordings using an ESP32 smartwatch motion sensor and a structured recording protocol, complemented by a synthetic dataset of 4h of labeled strumming audio. A Convolutional Recurrent Neural Network (CRNN) model is trained to detect strumming events, classify their direction, and identify the corresponding chords using only microphone audio. Our evaluation demonstrates significant improvements over baseline onset detection algorithms, with a hybrid method combining synthetic and real-world data achieving the highest accuracy for both strumming action detection and chord classification. These results highlight the potential of deep learning for robust guitar strumming transcription and open new avenues for automatic rhythm guitar analysis.


Postprint §
DOI: 10.5445/IR/1000184108
Veröffentlicht am 26.09.2025
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Industrielle Informationstechnik (IIIT)
Publikationstyp Proceedingsbeitrag
Publikationsdatum 22.09.2025
Sprache Englisch
Identifikator KITopen-ID: 1000184108
Erschienen in Proceedings of the 26th International Society for Music Information Retrieval Conference (ISMIR), Daenjong, Südkorea, 21st-25th September 2025
Veranstaltung 26th International Society for Music Information Retrieval Conference (ISMIR 2025), Daejong, Südkorea, 21.09.2025 – 25.09.2025
KIT – Die Universität in der Helmholtz-Gemeinschaft
KITopen Landing Page