Skip to content

ricebus/PastebinScraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PastebinScraper

Scrape pastes from pastebin.com

Run (from project dir)

pip install -r requirements.txt
export SCRAPER_MODE="db"
export SCRAPER_CONN_STRING="mongodb://127.0.0.1:27017/"
python main.py

Docker (from project dir)

docker build -t python-pastebin-scraper:latest .
docker pull mongo:latest
sudo docker run -d -p 27017-27019:27017-27019 \
-v /tmp/data:/data/db \
--name mongodb mongo
docker run -d \
-e SCRAPER_MODE="db" \
-e SCRAPER_CONN_STRING="mongodb://mongodb:27017/" \
--name scraper --link mongodb python-pastebin-scraper:latest

NOTE

file mode only dumps data

About

Scrape pastes from pastebin.com

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published