GitHub - kennethreitz-archive/heroku-splinder: Heroku mass-scraper for @archiveteam.

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 13 Commits
.ssh		.ssh
bin		bin
data		data
include		include
logs		logs
rsync-3.0.9		rsync-3.0.9
share/man		share/man
user_grabber		user_grabber
BeautifulSoup.py		BeautifulSoup.py
BeautifulSoup.pyc		BeautifulSoup.pyc
Makefile		Makefile
Procfile		Procfile
README		README
check-dld.sh		check-dld.sh
dld-client.sh		dld-client.sh
dld-profile.sh		dld-profile.sh
dld-single.sh		dld-single.sh
dld-streamer.sh		dld-streamer.sh
downloads.log		downloads.log
du-helper.sh		du-helper.sh
extract-urls-from-html.py		extract-urls-from-html.py
fix-dld.sh		fix-dld.sh
get-wget-warc.sh		get-wget-warc.sh
requirements.txt		requirements.txt
rsync-3.0.9.tar.gz		rsync-3.0.9.tar.gz
run.py		run.py
upload-finished.sh		upload-finished.sh
wget-warc		wget-warc

Repository files navigation

Here be scripts for downloading Splinder.com.

Usage:

# install wget-warc (or copy your wget-warc binary from the MobileMe directory)
./get-wget-warc.sh

# run a client
./dld-client.sh YOURNICK

kennethreitz-archive/heroku-splinder

Folders and files

Latest commit

History

Repository files navigation

About

Resources

Stars

Watchers

Forks

Languages