KIT | KIT-Bibliothek | Impressum | Datenschutz

TraceGate: A Framework for Policy-Controlled Failure Evidence in LLM-Assisted Program Repair

Schuler, Nicolas ORCID iD icon 1; Scotti, Vincenzo ORCID iD icon 1; Mirandola, Raffaela 1
1 Institut für Informationssicherheit und Verlässlichkeit (KASTEL), Karlsruher Institut für Technologie (KIT)

Abstract:

TraceGate is a reusable research artifact for policy-controlled disclosure of crash evidence in LLM-assisted program repair. Rather than relying on fixed evidence bundles or unconstrained LLM-driven tool usage, TraceGate mediates the repair process by capturing structured crash snapshots, selecting evidence and budget actions according to configurable policies, materializing the selected evidence for existing repair backends, validating candidate patches, and logging decisions and outcomes. The artifact provides backend adapters, benchmark workflows, evaluation scripts, and recorded logs to enable reproducible studies of failure-time observability and cost-success trade-offs. In evaluations across four Python benchmarks, five repair backends, and three model sizes, TraceGate recovered an average of 20.5% of residual failures, i.e., tasks that remained unsolved after the underlying backends had exhausted their own repair attempts.
Screencast: https://youtu.be/Gcr6A7tVBis Artifact: https://github.com/NicolasSchuler/tracegate Data: https://zenodo.org/records/19678467


Verlagsausgabe §
DOI: 10.5445/IR/1000199033
Veröffentlicht am 12.11.2026
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Informationssicherheit und Verlässlichkeit (KASTEL)
Publikationstyp Proceedingsbeitrag
Publikationsdatum 07.10.2026
Sprache Englisch
Identifikator ISBN: 979-8-4007-2882-2
KITopen-ID: 1000199033
HGF-Programm 46.23.01 (POF IV, LK 01) Methods for Engineering Secure Systems
Erschienen in Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering
Veranstaltung 41st IEEE/ACM International Conference on Automated Software Engineering (ASE 2026), München, Deutschland, 12.10.2026 – 16.10.2026
Verlag Association for Computing Machinery (ACM)
Seiten 3369 - 3372
Externe Relationen Siehe auch
Schlagwörter Automatic Program Repair, Debugging, Large Language Models
Nachgewiesen in Scopus
OpenAlex
Relationen in KITopen
KIT – Die Universität in der Helmholtz-Gemeinschaft
KITopen Landing Page