KIT | KIT-Bibliothek | Impressum | Datenschutz

Benchmarking the Utility of š¯‘¤-event Differential Privacy Mechanisms ā€“ When Baselines Become Mighty Competitors

Schäler, Christine ORCID iD icon 1; Hütter, Thomas; Schäler, Martin
1 Institut fĆ¼r Programmstrukturen und Datenorganisation (IPD), Karlsruher Institut fĆ¼r Technologie (KIT)

Abstract:

The š¯‘¤-event framework is the current standard for ensuring differential privacy on continuously monitored data streams. Following the proposition ofš¯‘¤-event differential privacy, various mechanisms to implement the framework were proposed. Their comparability in empirical studies is vital for both practitioners to choose a suitable mechanism and researchers to identify current limitations and propose novel mechanisms. By conducting a literature survey, we observe that the results of existing studies are hardly comparable and partially intrinsically inconsistent.
To this end, we formalize an empirical study of š¯‘¤-event mechanisms by a four-tuple containing re-occurring elements found in our survey. We introduce requirements on these elements that ensure the comparability of experimental results. Moreover, we propose a benchmark that meets all requirements and establishes a new way to evaluate existing and newly proposed mechanisms. Conducting a large-scale empirical study, we gain valuable new insights into the strengths and weaknesses of existing mechanisms. An unexpected ā€“ yet explainable ā€“ result is a baseline supremacy, i.e., using one of the two baseline mechanisms is expected to deliver good or even the best utility. ... mehr


Volltext Ā§
DOI: 10.5445/IR/1000149541
Cover der Publikation
Zugehƶrige Institution(en) am KIT Institut fĆ¼r Programmstrukturen und Datenorganisation (IPD)
Publikationstyp Forschungsbericht/Preprint
Publikationsjahr 2022
Sprache Englisch
Identifikator ISSN: 2194-1629
KITopen-ID: 1000149541
Verlag Karlsruher Institut fĆ¼r Technologie (KIT)
Umfang [13] S.
Serie KIT Scientific Working Papers ; 194
KIT ā€“ Die ForschungsuniversitƤt in der Helmholtz-Gemeinschaft
KITopen Landing Page