Skip to content

jdeepee/RepEval-2016

 
 

Repository files navigation

RepEval-2016

Here contain the scripts and code used in Repeval 2016 paper:
Intrinsic Evaluation of Word Vectors Fails to Predict Extrinsic Performance

API Package

word2vec: original word2vec from Mikolov (https://code.google.com/archive/p/word2vec/)
wvlib: lib to read word2vec file (https://github.com/spyysalo/wvlib)

Scripts

createRawText.sh: download file for creating raw corpus
createCorpus.sh: Pre-process text (input: raw corpus directory)
createModel.sh: Create word2vec.bin file with different window size
intrinsicEva.sh: run intrinsic evaluation on 8 benchmark data-set (input: Dir. for testing vector)
ExtrinsicEva.sh: run extrinsic evaluation

Code

Pre-processing:
tokenize_text.py: tokenized text (need NLTK installed)
sentence_spliter.py: segment sentence

Intrinsic evaluation:
evaluate.py: perform intrinisic evaluation

Extrinsic evaluation: (Keras folder: Need either tensorflow or theano installed):
mlp.py: simple feed-forward Neural Network
setting.py: parameters for the Neual Network

Remark

https://drive.google.com/open?id=0BzMCqpcgEJgic0ttWTlyLWZOSVk

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 74.9%
  • C 9.6%
  • Roff 6.8%
  • Perl 4.9%
  • Shell 3.7%
  • Makefile 0.1%