Decentralized Search on Decentralized Web

08/18/2018 ∙ by Ziliang Lai, et al. ∙ 0

Decentralized Web, or DWeb, is envisioned as a promising future of the Web. Being decentralized, there are no dedicated web servers in DWeb; Devices that retrieve web contents also serve their cached data to peer devices with straight privacy-preserving mechanisms. The fact that contents in DWeb are distributed, replicated, and decentralized lead to a number of key advantages over the conventional web. These include better resiliency against network partitioning and distributed-denial-of-service attacks (DDoS), and better browsing experiences in terms of shorter latency and higher throughput. Moreover, DWeb provides tamper-proof contents because each content piece is uniquely identified by a cryptographic hash. DWeb also clicks well with future Internet architectures, such as Named Data Networking (NDN).Search engines have been an inseparable element of the Web. Contemporary ("Web 2.0") search engines, however, provide centralized services. They are thus subject to DDoS attacks, insider threat, and ethical issues like search bias and censorship. As the web moves from being centralized to being decentralized, search engines ought to follow. We propose QueenBee, a decentralized search engine for DWeb. QueenBee is so named because worker bees and honeycomb are a common metaphor for distributed architectures, with the queen being the one that holds the colony together. QueenBee aims to revolutionize the search engine business model by offering incentives to both content providers and peers that participate in QueenBee's page indexing and ranking operations.



There are no comments yet.


page 1

page 2

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.


  • [1] J. Benet. Ipfs-content addressed, versioned, p2p file system. arXiv preprint arXiv:1407.3561, 2014.
  • [2] M. Herrmann, K.-C. Ning, C. Diaz, and B. Preneel. Description of the yacy distributed web search engine. Technical Report, KU Leuven ESAT/COSIC, IMinds, 2014.
  • [3] L. M. Hinman. Searching ethics: The role of search engines in the construction and distribution of knowledge. In Web search. Springer, 2008.
  • [4] B. Kahle. Locking the web open: A call for a decentralized web., 2015.
  • [5] J. Kulshrestha, M. Eslami, J. Messias, M. B. Zafar, S. Ghosh, K. P. Gummadi, and K. Karahalios. Quantifying search bias: Investigating sources of bias for political searches in social media. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 2017.
  • [6] R. M. Needham. Denial of service. In Proceedings of the 1st ACM Conference on Computer and Communications Security. ACM, 1993.
  • [7] L. Spitzner. Honeypots: Catching the insider threat. In Computer Security Applications Conference, 2003. Proceedings. 19th Annual. IEEE, 2003.
  • [8] G. Wood. Ethereum: A secure decentralised generalised transaction ledger. Ethereum project yellow paper, 2014.
  • [9] L. Zhang, A. Afanasyev, J. Burke, V. Jacobson, P. Crowley, C. Papadopoulos, L. Wang, B. Zhang, et al. Named data networking. ACM SIGCOMM Computer Communication Review, 2014.