KIT | KIT-Bibliothek | Impressum | Datenschutz

On the Similarity of Web Measurements Under Different Experimental Setups

Demir, Nurullah ORCID iD icon 1; Hörnemann, Jan; Große-Kampmann, Matteo; Urban, Tobias; Holz, Thorsten 2; Pohlmann, Norbert; Wressnegger, Christian 1
1 Institut für Informationssicherheit und Verlässlichkeit (KASTEL), Karlsruher Institut für Technologie (KIT)
2 Helmholtz-Zentrum für Informationssicherheit (CISPA)

Abstract:

Measurement studies are essential for research and industry alike to understand the Web's inner workings better and help quantify specific phenomena. Performing such studies is demanding due to the dynamic nature and size of the Web. An experiment's careful design and setup are complex, and many factors might affect the results. However, while several works have independently observed differences in the outcome of an experiment (e.g., the number of observed trackers) based on the measurement setup, it is unclear what causes such deviations.
This work investigates the reasons for these differences by visiting 1.7M webpages with five different measurement setups. Based on this, we build `dependency trees' for each page and cross-compare the nodes in the trees. The results show that the measured trees differ considerably, that the cause of differences can be attributed to specific nodes, and that even identical measurement setups can produce different results.


Originalveröffentlichung
DOI: 10.1145/3618257.3624795
Scopus
Zitationen: 1
Zugehörige Institution(en) am KIT Institut für Informationssicherheit und Verlässlichkeit (KASTEL)
Kompetenzzentrum für angewandte Sicherheitstechnologie (KASTEL)
Publikationstyp Proceedingsbeitrag
Publikationsjahr 2023
Sprache Englisch
Identifikator ISBN: 979-840070382-9
KITopen-ID: 1000161625
Erschienen in Proceedings of the 23nd ACM Internet Measurement Conference, 23nd ACM Internet Measurement Conference (2023) Montreal, Kanada, 24.10.2023–26.10.2023
Veranstaltung 23nd ACM Internet Measurement Conference (2023), Montreal, Kanada, 24.10.2023 – 26.10.2023
Verlag Association for Computing Machinery (ACM)
Seiten 356 – 369
Bemerkung zur Veröffentlichung in press
Vorab online veröffentlicht am 10.09.2023
Externe Relationen Forschungsdaten/Software
Schlagwörter Web Measurement Studies, Reproducibility, Privacy, Robustness, Metascience, Meta-research
Nachgewiesen in Scopus
Relationen in KITopen
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page