KIT | KIT-Bibliothek | Impressum | Datenschutz

nlrpBENCH: A Benchmark for Natural Language Requirements Processing

Tichy, Walter F. ORCID iD icon; Landhäußer, Mathias; Körner, Sven J.


We present nlrpBENCH: a new platform and framework to improve soft-
ware engineering research as well as teaching with focus on requirements engineering
during the software engineering process. It is available on http://nlrp.ipd.
Recent advances in natural language processing have made it possible to process
textual software requirements automatically, for example checking them for flaws or
translating them into software artifacts. This development is particularly fortunate,
as the majority of requirements is written in unrestricted natural language. However,
many of the tools in in this young area of research have been evaluated only on limited
sets of examples, because there is no accepted benchmark that could be used to assess
and compare these tools. To improve comparability and thereby accelerate progress,
we have begun to assemble nlrpBENCH, a collection of requirements specifications
meant both as a challenge for tools and a yardstick for comparison.
We have gathered over 50 requirement texts of varying length and difficulty and
organized them in benchmark sets. At present, there are two task types: model extrac-
... mehr

Zugehörige Institution(en) am KIT Institut für Programmstrukturen und Datenorganisation (IPD)
Publikationstyp Proceedingsbeitrag
Publikationsjahr 2015
Sprache Englisch
Identifikator ISBN: 978-3-88579-633-6
ISSN: 1617-5468
KITopen-ID: 1000051692
Erschienen in Multikonferenz Software Engineering & Management 2015 : 1Multikonferenz der GI-Fachbereiche Softwaretechnik (SWT) und Wirtschaftsinformatik (WI), FA WI-MAW, 17. März - 20. März 2015 in Dresden, Germany. Hrsg.: U. Aßmann
Verlag Gesellschaft für Informatik (GI)
Serie GI-Edition : lecture notes in informatics ; 239
Externe Relationen Abstract/Volltext
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page