KIT | KIT-Bibliothek | Impressum | Datenschutz

Towards Improving Large Language Models’ Planning Capabilities onWoT Thing Descriptions by Generating Python Objects as Intermediary Representations

Kinder, Lukas 1; Käfer, Tobias ORCID iD icon 2
1 Karlsruher Institut für Technologie (KIT)
2 Institut für Angewandte Informatik und Formale Beschreibungsverfahren (AIFB), Karlsruher Institut für Technologie (KIT)

Abstract:

This paper presents a novel method for plan generation with Large Language Model(LLM). We propose utilizing
Web-of-Thing Thing Descriptions (WoT TD) to inform the LLM about available devices for interaction. We
investigate a novel pipeline in which: (1) The WoT TD gets translated into a Python class, (2) The task in natural
language gets translated into code that interact with this class, (3) The generated code gets executed to obtain the
plan. We evaluate our approach featuring 6 different state of the art LLMs. We get performance improvements
of up to 12%, when comparing our approach against existing LLM-based planning methods. Furthermore, we
explore the influence of different aspects of WoT TDs on planning capabilities. This research paves the way
towards more potent LLM planning models by introducing Python classes as intermediaries, simplifying the final
planning task while leveraging standardized and accessible domain knowledge provided by WoT TDs.


Verlagsausgabe §
DOI: 10.5445/IR/1000174642
Veröffentlicht am 01.10.2024
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Angewandte Informatik und Formale Beschreibungsverfahren (AIFB)
KIT-Bibliothek (BIB)
Publikationstyp Proceedingsbeitrag
Publikationsmonat/-jahr 08.2024
Sprache Englisch
Identifikator ISSN: 1613-0073
KITopen-ID: 1000174642
Erschienen in Joint Proceedings of the ESWC 2024 Workshops and Tutorials (ESWC-JP 2024), Hersonissos, Greece, May 26-27, 2024
Veranstaltung 21st Extended Semantic Web Conference (ESWC 2024), Hersonissos, Griechenland, 26.05.2024 – 30.05.2024
Verlag CEUR-WS
Serie CEUR workshop proceedings ; 3749
Vorab online veröffentlicht am 26.08.2024
Nachgewiesen in Scopus
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page