GitHub - hagerpa/ml_project: ml_project, natural language procession.

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 84 Commits
best_estimators		best_estimators
cv_results		cv_results
nb_archive		nb_archive
.gitignore		.gitignore
Readme.txt		Readme.txt
categories.py		categories.py
category.csv		category.csv
corpus.pkl		corpus.pkl
corpus.py		corpus.py
corpus_main.pkl		corpus_main.pkl
corpus_sub.pkl		corpus_sub.pkl
cross_validation.ipynb		cross_validation.ipynb
cv_final_method.ipynb		cv_final_method.ipynb
evaluation_final_method.ipynb		evaluation_final_method.ipynb
extract_features.py		extract_features.py
feature_extractors.py		feature_extractors.py
filters.py		filters.py
final_method_main.pkl		final_method_main.pkl
final_method_sub.pkl		final_method_sub.pkl
information_gain.npy		information_gain.npy
moving_on.ipynb		moving_on.ipynb
predict_question_category.py		predict_question_category.py
question_category_train.csv		question_category_train.csv
question_test.csv		question_test.csv
question_train.csv		question_train.csv
reading_evaluations.ipynb		reading_evaluations.ipynb
spell_checker.py		spell_checker.py
testing_area.ipynb		testing_area.ipynb
train_apply_classifier.py		train_apply_classifier.py
transform.py		transform.py
vocabulary_builders.py		vocabulary_builders.py

Repository files navigation

The following files belong to the project:

categories.py 			#manages categories, subcategories and their Frequencies
corpus.py 			#keeps track of all training examples, procession of the text, and the te,tr-set split
filters.py 			#filtering methods
vocabulary_builders.py 	#term-space reduction methods
feature_extractors.py		#methods for creating numeric features

The code is written in python3 and needs the following additional packages:
numpy
pickle
tempfile
nltk
csv
re
itertools