[olug] Spider

[Sean Kelly]

On Tue, Sep 28, 2004 at 08:29:07AM -0500, John Dickson wrote:
> Does anyone have any suggestions on a Spider server that collects site (web servers) information on predefined criteria? By that I mean I would like to have a server hit sites to look for terms or collect terms and filter later.

Try Ht::Dig. http://www.htdig.org/

-- 
Sean Kelly         | PGP KeyID: D2E5E296
smkelly at zombie.org | http://www.zombie.org