KIT | KIT-Bibliothek | Impressum | Datenschutz

An interactive action set detection in natral language hybrid system

Wachtel, Alexander; Paczia, Jonas; Tichy, Walter F. ORCID iD icon


In this paper, we introduce an interface for natural language dialog system and the Microsoft Excel API. This interface enables users to describe actions in unrestricted natural language interactively and run these actions in the technical domain like Microsoft Excel. We implement a hybrid system that supports natural language interactions similar as a chat bot and gesture control to follow the user’s showing actions. For this purpose and also to avoid the lack of inconsistent code documentation, we dynamically export the provided documentation for coding in Visual Studio and provide it in the xml-format to the hybrid system. Users can use already existing actions and provide new action sets to the hybrid system at runtime. For our first prototype of the hybrid system, we concentrate on extending for handling graphs and charts. Evaluated by a user study the hybrid system can successfully resolve more that 80 % of the given user tasks.

Zugehörige Institution(en) am KIT Institut für Programmstrukturen und Datenorganisation (IPD)
Publikationstyp Proceedingsbeitrag
Publikationsjahr 2017
Sprache Englisch
Identifikator ISBN: 978-989-8533-64-7
KITopen-ID: 1000072438
Erschienen in 11th International Conference on Interfaces and Human Computer Interaction, Lisbon, Portugal, 21st - 23rd July 2017
Verlag IADIS Press
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page