This site may earn affiliate commissions from the links on this page. Terms of use.

The Cyberspace is less of a wild w than information technology once was, but there are still corners of it that are obscured from view and quite shady. For instance, Tor hidden services have included numerous criminal enterprises like The Silk Road. 2 researchers from Male monarch'south Higher London set out to discover but how much of Tor was devoted to illegal content. The result? Nearly of it.

Tor (which originally stood for The Onion Router) is a network composed of layers of encrypted relays through which information is passed. Each node in the network but knows where a bundle only was and where it's going next. Afterwards a few hops, the source of a parcel is (almost) impossible to discern. Most people apply Tor to achieve sites on the open Cyberspace anonymously, but there are also sites that are hosted entirely within Tor, called hidden services. The Silk Road was a hidden service, merely there are innumerable others. It is these sites Daniel Moore and Thomas Rid sought to quantify.

It's no easy task to observe all the subconscious services on Tor, allow alone get a look at the data they're hosting. Hidden services are ephemeral, often switching addresses and server locations without notice. To top it off, Tor addresses are just long strings of characters with a .onion domain at the end. In order to get a proper sample of all the hidden services lurking out there, the pair built a Python script that crawled the dark web, starting with the popular Tor search engines Onion City and Ahmia.

The bot's task was to scrape the content from each page and upload it for analysis. When the bot found a link to another hidden service (the master way you find things on the nighttime web), it would hop to that one and scrape information technology too. The pair used an algorithm to process all the content collected and sort information technology into categories like drugs, social, pornography, and financial. The sorting was spot checked and found to exist very accurate overall.

hidden service

Afterwards the script had run its grade, 5,205 alive websites were indexed; a total of ii,723 pages were classified by content. Pages with fewer than 50 words and those with no content were dropped in the "none" category. According to the analysis, 57% of the sites hosted illicit content like drugs and child pornography. The Tor project estimates there are about 35,000 full subconscious services active, so this is far from a full survey, merely enough to exist a representative sample.

Moore and Rid say their goal with this project was to establish a more than moderate perspective on the role of encryption. Politicians are currently enervating unworkable backdoors to encryption, but Moore and Rid say that privacy activists fail to fully acknowledge the potential for abuse. They don't have a solution in heed — they're but making the information available.