Name		Name	Last commit message	Last commit date
Latest commit History 128 Commits
20news-18828		20news-18828
esa_example		esa_example
lit		lit
.gitignore		.gitignore
README.md		README.md
b.txt		b.txt
call-for-presentations.txt.GloveModel.segmented.pickle		call-for-presentations.txt.GloveModel.segmented.pickle
call-for-presentations.txt.colored.pdf		call-for-presentations.txt.colored.pdf
cluster_counts.py		cluster_counts.py
clustered-esa-results.tsv		clustered-esa-results.tsv
deepnet.py		deepnet.py
display_regions.py		display_regions.py
distributedwordreps.py		distributedwordreps.py
esa-flat-naivebayes-20.txt		esa-flat-naivebayes-20.txt
esa.py		esa.py
eval.sh		eval.sh
explore_decay.sh		explore_decay.sh
explore_depth.sh		explore_depth.sh
final-paper-hierarchical.pdf		final-paper-hierarchical.pdf
glove-results.tsv		glove-results.tsv
glove.py		glove.py
ignore.txt		ignore.txt
json2csv.py		json2csv.py
lda-results.tsv		lda-results.tsv
lda100-records-decay.tsv		lda100-records-decay.tsv
lda_baseline.py		lda_baseline.py
lda_segmentation.py		lda_segmentation.py
lda_topK_fine_tune_no_val.log_Tue Jun 9 16:21:13 2015		lda_topK_fine_tune_no_val.log_Tue Jun 9 16:21:13 2015
lda_topK_fine_tune_no_val.log_Tue Jun 9 17:45:58 2015		lda_topK_fine_tune_no_val.log_Tue Jun 9 17:45:58 2015
lda_topK_fine_tune_val.log_Tue Jun 9 16:26:08 2015		lda_topK_fine_tune_val.log_Tue Jun 9 16:26:08 2015
lda_topK_fine_tune_val.log_Tue Jun 9 16:26:25 2015		lda_topK_fine_tune_val.log_Tue Jun 9 16:26:25 2015
lda_topK_parameter_rough_result.txt		lda_topK_parameter_rough_result.txt
main.py		main.py
make_glove_dict.py		make_glove_dict.py
make_lda_lsa_model.py		make_lda_lsa_model.py
models.py		models.py
parallelize-segment-topic-search.sh		parallelize-segment-topic-search.sh
project_overview.txt		project_overview.txt
records-decay.tsv		records-decay.tsv
run_kmeans_on_shards.py		run_kmeans_on_shards.py
sampleDoc.txt		sampleDoc.txt
segment-topic-search.py		segment-topic-search.py
test.py		test.py
test_no_validation.py		test_no_validation.py
topk-evaluate.py		topk-evaluate.py
tsne.py		tsne.py
unreasonable.txt		unreasonable.txt
util.py		util.py
wiki_en_wordids.txt		wiki_en_wordids.txt

Repository files navigation

cs224u

Working with the Glove model

Download the "Wikipedia 2014 + Gigaword 5 (6B tokens)" 300d glove dataset from http://nlp.stanford.edu/projects/glove/
Note: the original file is named .gz but is not compressed, you may want to just rename it to .txt
Convert into numpy format via: ./make_glove_dict.py glove.6B.300d.txt
Run the evaluation: ./main.py glove.6B.300d.txt ./20news-18828

consciousgaze/cs224u

Folders and files

Latest commit

History

Repository files navigation

cs224u

Working with the Glove model

About

Resources

Stars

Watchers

Forks

Languages