Spider

A piece of software (also called a Web crawler) designed to follow hyperlinks to their completion, and return information on Internet addresses passed.