DeepAI AI Chat
Log In Sign Up

The Blind Men and the Internet: Multi-Vantage Point Web Measurements

by   Jordan Jueckstock, et al.

In this paper, we design and deploy a synchronized multi-vantage point web measurement study to explore the comparability of web measurements across vantage points (VPs). We describe in reproducible detail the system with which we performed synchronized crawls on the Alexa top 5K domains from four distinct network VPs: research university, cloud datacenter, residential network, and Tor gateway proxy. Apart from the expected poor results from Tor, we observed no shocking disparities across VPs, but we did find significant impact from the residential VP's reliability and performance disadvantages. We also found subtle but distinct indicators that some third-party content consistently avoided crawls from our cloud VP. In summary, we infer that cloud VPs do fail to observe some content of interest to security and privacy researchers, who should consider augmenting cloud VPs with alternate VPs for cross-validation. Our results also imply that the added visibility provided by residential VPs over university VPs is marginal compared to the infrastructure complexity and network fragility they introduce.


The Use of Web Archives in Disinformation Research

In recent years, journalists and other researchers have used web archive...

Web Archive Analytics

Web archive analytics is the exploitation of publicly accessible web pag...

The Internet with Privacy Policies: Measuring The Web Upon Consent

To protect users' privacy, legislators have regulated the usage of track...

An Empirical Analysis of VM Startup Times in Public IaaS Clouds: An Extended Report

VM startup time is an essential factor in designing elastic cloud applic...

Exploring the Cookieverse: A Multi-Perspective Analysis of Web Cookies

Web cookies have been the subject of many research studies over the last...

Measuring and exploiting the cloud consolidation of the Web

We present measurements showing that the top one million most popular We...