Skip to content
/ simple_crawler Public

A very simple crawler, nothing you would use in production

0 stars 0 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

stefano/simple_crawler

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits

.gitignore

.gitignore

 
 

README

README

 
 

crawler.py

crawler.py

 
 

requirements.txt

requirements.txt

 
 

Repository files navigation

A simple crawler.

It requires python 3.

Build:

    $ virtualenv -p python3 .env
    $ . .env/bin/activate
    $ pip install -r requirements.txt

Usage:

    $ python crawler.py http://<root url>

About

A very simple crawler, nothing you would use in production

Resources

Readme
Activity

Stars

0 stars

Watchers

2 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages