GitHub - maxfarnham/CS491Proj

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 67 Commits
491_Spider		491_Spider
Corpus		Corpus
downloads		downloads
handlers		handlers
.gitignore		.gitignore
20150424-200041lda_log.txt		20150424-200041lda_log.txt
README		README
binary.csv		binary.csv
buildcorp.py		buildcorp.py
dataset_utilities.py		dataset_utilities.py
dataset_utilities.pyc		dataset_utilities.pyc
demo.py		demo.py
entity_recognition.py		entity_recognition.py
features.csv		features.csv
file_io.py		file_io.py
frameSVM_news.txt		frameSVM_news.txt
frankenfile.txt		frankenfile.txt
gxdxtzr2.ttf.txt		gxdxtzr2.ttf.txt
intersection_entity.txt		intersection_entity.txt
intersection_entity14.txt		intersection_entity14.txt
lda_improved.py.lprof		lda_improved.py.lprof
lda_log20150424-211415.txt		lda_log20150424-211415.txt
lda_log20150424-213647.txt		lda_log20150424-213647.txt
lda_log20150424-214906.txt		lda_log20150424-214906.txt
lda_log20150424-215439.txt		lda_log20150424-215439.txt
lda_log20150424-220429.txt		lda_log20150424-220429.txt
lda_log20150424-221406.txt		lda_log20150424-221406.txt
lda_log20150424-221619.txt		lda_log20150424-221619.txt
lda_log20150424-222452.txt		lda_log20150424-222452.txt
lda_log20150424-234228.txt		lda_log20150424-234228.txt
lda_log20150425-012923.txt		lda_log20150425-012923.txt
lda_log20150425-115456.txt		lda_log20150425-115456.txt
lda_matrix.py		lda_matrix.py
lda_matrix.py.lprof		lda_matrix.py.lprof
lda_matrix.pyc		lda_matrix.pyc
local.py		local.py
logistic.py		logistic.py
logistic.pyc		logistic.pyc
lsa.py		lsa.py
lsa.txt		lsa.txt
naive.py		naive.py
naive.pyc		naive.pyc
pageparser.py		pageparser.py
pattern_bayes.py		pattern_bayes.py
profstates		profstates
stopwords.txt		stopwords.txt
test.txt		test.txt
text_manip.py		text_manip.py
texthandler.py		texthandler.py
trie.py		trie.py

Repository files navigation

see demo for usage. raw_html requires BeautifulSoup and nltk



REQUIREMENTS (may need to get this in a requirements.txt):
pattern:
	https://github.com/clips/pattern
nltk
textblob