wget http://voltran.cmpe.boun.edu.tr/temporary_download/datasets/tbmm/tbmm-corpus-v0.1.tar.gz
tar -zxvf tbmm-corpus-v0.1.tar.gz
wget http://voltran.cmpe.boun.edu.tr/temporary_download/datasets/tbmm/corpus-dev.tar.gz
tar -zxvf corpus-dev.tar.gz
pip3 install pipenv
pipenv install --python 3
Example code to save a figure:
pipenv shell
ipython
import corpus_loader
# plot distribution of "mebus" and "milletvekil" keywords
corpus_loader.corpus.plot_word_freqs_given_a_regexp_for_each_year([r"^mebus",r"^milletvekil"], keyword="milletvekil_and_mebus",)
# to see plotted values
plot_values, counts, total_count, all_keywords = corpus_loader.corpus._word_freqs_given_a_regexp_for_each_year(r"^(milletvekil|vekil)", keyword="milletvekil",)
You can use the notebook.ipynb file to load and query the corpus.
Run below command to test the new clean text suit.
python3 cleaning_text_files.py