Wikicorpus

This repo records a list of Wikipedia-related corpora

Off-the-shelf

wiki.xml: Extracted file from English Wiki-dump (10Oct2014) using Wikipedia_Extractor

SeedLing: a seed corpus for the Human Language Project
Lucene Wiki: After downloading wiki.xml, you can use WikiIndexer.py to index the text with pylucene.

Name		Name	Last commit message	Last commit date
Latest commit History 14 Commits
README.md		README.md
WIKI_chemical		WIKI_chemical
WIKI_equipment		WIKI_equipment
WIKI_food		WIKI_food
WIKI_food_indexed_tokenized		WIKI_food_indexed_tokenized
WIKI_science		WIKI_science
WikiIndex.py		WikiIndex.py