KIT | KIT-Bibliothek | Impressum | Datenschutz

Measuring Service Encounter Satisfaction with Customer Service Chatbots using Sentiment Analysis

Feine, Jasper; Morana, Stefan; Gnewuch, Ulrich


Chatbots are software-based systems designed to interact with humans using text-based natural language and have attracted considerable interest in online service encounters. In this context, service providers face the challenge of measuring chatbot service encounter satisfaction (CSES), as most approaches are limited to post-interaction surveys that are rarely answered and often biased. As a result, service providers cannot react quickly to service failures and dissatisfied customers. To address this challenge, we investigate the application of automated sentiment analysis methods as a proxy to measure CSES. Therefore, we first compare different sentiment analysis methods. Second, we investigate the relationship between objectively computed sentiment scores of dialogs and subjectively measured CSES values. Third, we evaluate whether this relationship also exists for utterance sequences throughout the dialog. The paper contributes by proposing and applying an automatic and objective approach to use sentiment scores as a proxy to measure CSES.

Zugehörige Institution(en) am KIT Fakultät für Wirtschaftswissenschaften – Institut für Informationswirtschaft und Marketing (IISM)
Publikationstyp Proceedingsbeitrag
Publikationsjahr 2019
Sprache Englisch
Identifikator KITopen-ID: 1000090877
Erschienen in 14. Internationale Tagung Wirtschaftsinformatik (WI2019)
Veranstaltung 14. Internationale Tagung Wirtschaftsinformatik (Wi 2019), Siegen, Deutschland, 23.02.2019 – 27.02.2019
Seiten 1115-1129
Vorab online veröffentlicht am 29.01.2019
Externe Relationen Siehe auch
Relationen in KITopen
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page