From the very first days of the world wide web, engineers used webcrawlers (automated bots that move randomly between websites) to collect information about the newly created sites. But the question ...