Binary-tree visualization of the Yahoo search engine bot crawling the experimental website.

A fascinating research on search engine bots’ behaviour beautifully represented with tree graphs and animation:

In the previous edition - Binary Search Tree 2 - a large scale experiment on search engine behaviour was staged with more than two billion different web pages. This experiment lasted exactly one year, until April 13th. In this period the three major search engines requested more than one million pages of the tree, from more than hundred thousand different URLs. The home page of drunkmenworkhere.org grew from 1.6 kB to over 4 MB due to the visit log and the comment spam displayed there.
This edition presents the results of the experiment.

Don’t miss the animated graph showing growing trees for each search engine’s bot.

On Bots

Tags: information graphics, information visualization, graphs, animated graphs, animation
This entry was posted on Wednesday, May 10th, 2006 at 6:13 pm and is filed under links. You can skip to the end and leave a response. Pinging is currently not allowed.