Thomas Weber

A Java Web crawler: multi-threaded, scalable, with high performance, extensible and polite. It can be used to crawl, index, load-test or even download any web or enterprise domain and is configurable through a XML configuration file. Phoneutria can be used for either checking the links of website ... [More] or for load-testing purposes (i.e. the level of politeness can be configured). It provides a plug-in mechanism for further extensions. [Less]