[olug] Spider

[Christopher Cashell]

At Tue, 28 Sep 04, Unidentified Flying Banana John Dickson, said:
> Does anyone have any suggestions on a Spider server that collects site
> (web servers) information on predefined criteria? By that I mean I
> would like to have a server hit sites to look for terms or collect
> terms and filter later.

I just came across this link[0] from LinuxToday, which is titled "Run
Your Own Spider".

It looks like it has some decent links to some open source web spiders.

> John


 [0] http://www.sitepoint.com/blog-post-view.php?id=198478

-- 
| Christopher
+------------------------------------------------+
| Here I stand.  I can do no other.              |
+------------------------------------------------+