Skip to content

iakinsey/unshadow

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Unshadow

An experiment in web crawler development

A poorly hacked together web crawler and visualization utilities.

Build/start the container

sudo docker build .
sudo docker run -ti <container_id> /bin/bash

Run the crawler

./entrypoint.sh

Backup postgresql

In container

pg_dump -U unshadow -d unshadow > /backup

In host

sudo docker cp <container_id>:/backup ./backup

About

Python web crawler

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published