KIT | KIT-Bibliothek | Impressum | Datenschutz

LLM-Assisted Semantic Assessment of Entity-Relationship Diagrams in Conceptual Modeling Education

Ullrich, Meike ORCID iD icon 1; Aisenbrey, Fabian; Fritsch, Andreas ORCID iD icon 1
1 Institut für Angewandte Informatik und Formale Beschreibungsverfahren (AIFB), Karlsruher Institut für Technologie (KIT)

Abstract:

Providing timely and meaningful feedback on student-created conceptual models requires assessing syntactic and semantic correctness, the latter indicating whether a model adequately represents the intended domain. Existing rule- and label-based approaches provide limited support for alternative valid terminology and modeling decisions, while direct large language model (LLM) assessments may produce incomplete or inconsistent feedback. This paper presents an LLM-assisted semantic assessment approach for Entity-Relationship diagrams that combines explicit diagram mapping and deterministic difference detection with LLM-based semantic interpretation. The approach generates element-specific feedback and makes identified differences between the task description, the sample solution, and the submitted model transparent. It supports configurable assessment instructions and generates detailed formative feedback. Evaluation on student submissions shows that the assessment approach with explicit diagram mapping and deterministic difference detection produces substantially more complete and correct feedback than direct LLM assessment.


Zugehörige Institution(en) am KIT Institut für Angewandte Informatik und Formale Beschreibungsverfahren (AIFB)
Publikationstyp Proceedingsbeitrag
Publikationsjahr 2026
Sprache Englisch
Identifikator ISSN: 1613-0073
KITopen-ID: 1000198735
Erschienen in 2026 ER: Doctoral Consortium, Tutorials, Posters and Demos, ER-Companion 2026
Veranstaltung Doctoral Consortium, Tutorials, Posters and Demos (ER 2026), St. John’s, Kanada, 05.10.2026 – 08.10.2026
Verlag CEUR-WS
Seiten 36 - 40
Serie 4279
Externe Relationen Siehe auch
Schlagwörter automated assessment; conceptual modeling; Entity-Relationship diagrams; formative feedback; large language models; modeling education; semantic assessment
Nachgewiesen in Scopus
KIT – Die Universität in der Helmholtz-Gemeinschaft
KITopen Landing Page