Skip to content

artmalys/autosuggest-preprocessor

BranchesTags
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits

input

input

 
 

LICENSE

LICENSE

 
 

Query Logs Preprocessor.jpg

Query Logs Preprocessor.jpg

 
 

README.md

README.md

 
 

config_loader.py

config_loader.py

 
 

de_duplicator.py

de_duplicator.py

 
 

keyword_dictionary_builder.py

keyword_dictionary_builder.py

 
 

parser.py

parser.py

 
 

profanity_filter.py

profanity_filter.py

 
 

requirements.txt

requirements.txt

 
 

run.py

run.py

 
 

symspell_checker.py

symspell_checker.py

 
 

Repository files navigation

Autosuggest Preprocessor

Preprocessor

Clone master branch of this repository on your local.

Setup Python

  • Install python3.
  • Run pip install requirements.txt from inside the cloned repository folder.

Execute Script

  • Run run.py.
  • It will use the input/query_logs.txt file as input.
  • It will create the output folder with the processed files for different preprocessing steps.

About

Preprocesses the query logs which can be used by suggesters like Most Popular Suggester (MPS).

Resources

Readme

License

MIT license
Activity

Stars

0 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%