GitHub - asdbaihu/Arachne: Arachne is a simple in python written document crawler. At the moment Arachne only supports text files (*.txt), but this will be extended. I plan to integrate a pluginsystem for different crawling methods (web, irc, pdf, ..). Take a look at the search engine ("Horrorscope") ;)

asdbaihu / Arachne Public

forked from 0B5C/Arachne

Notifications
Fork 0
Star 0

Arachne is a simple in python written document crawler. At the moment Arachne only supports text files (*.txt), but this will be extended. I plan to integrate a pluginsystem for different crawling methods (web, irc, pdf, ..). Take a look at the search engine ("Horrorscope") ;)