Search engine (crawler, frontier, database, tbc)

Any wishes to be added to Url / UrlBank ? Maybe we should think bout using the fork system ? Dont wanna end up getting carved up

Name		Name	Last commit message	Last commit date
Latest commit History 34 Commits
.gitignore		.gitignore
Index.py		Index.py
IndexToken.py		IndexToken.py
Main_bank.py		Main_bank.py
Main_bank.py~		Main_bank.py~
PageRank.py		PageRank.py
README.md		README.md
Scorer.py		Scorer.py
Scorer.py#		Scorer.py#
Scorer.py~		Scorer.py~
Tokenizer.py		Tokenizer.py
Url.py		Url.py
Url.py~		Url.py~
UrlBank.py		UrlBank.py
UrlBank.py~		UrlBank.py~
crawler.py		crawler.py
crawler.py~		crawler.py~
frontier.py		frontier.py

warlockerino/Crawler