KIT | KIT-Bibliothek | Impressum | Datenschutz

Enhancing Flood Impact Analysis using Interactive Retrieval of Social Media Images

Barz, Björn; Schröter, Kai; Münch, Moritz; Yang, Bin; Unger, Andrea; Dransch, Doris; Denzler, Joachim

Abstract:

The analysis of natural disasters in a timely manner often suffers from limited sensor data. This limitation could be alleviated by leveraging information contained in images of the event posted on social media platforms, so-called “Volunteered Geographic Information (VGI)”. To save the analyst from manual inspection of all images posted online, we propose to use content-based image retrieval with the possibility of relevance feedback for retrieving only relevant images of the event. To evaluate this approach, we introduce a new dataset of 3,710 flood images, annotated by domain experts regarding their relevance with respect to three tasks (determining the flooded area, inundation depth, water pollution). We compare several image features and relevance feedback methods on that dataset, mixed with 97,085 distractor images, and are able to improve the precision among the top 100 results from 55% to 87% after 5 rounds of feedback.


Verlagsausgabe §
DOI: 10.5445/KSP/1000087327/06
Veröffentlicht am 13.03.2020
Cover der Publikation
Zugehörige Institution(en) am KIT Fakultät für Wirtschaftswissenschaften – Institut für Informationswirtschaft und Marketing (IISM)
Publikationstyp Zeitschriftenaufsatz
Publikationsjahr 2018
Sprache Englisch
Identifikator ISSN: 2363-9881
KITopen-ID: 1000117723
Erschienen in Archives of Data Science, Series A (Online First)
Band 5
Heft 1
Seiten A06, 21 S. online
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page