Search_Engine

In order for you to be able to run the search engine these are the requierments: click==7.1.2 joblib==0.17.0 nltk==3.5 numpy==1.15.4 pandas==1.1.4 pyarrow==2.0.0 python-dateutil==2.8.1 pytz regex==2020.10.28 six==1.15.0 tqdm==4.51.0 demoji==0.3.0 pyspellchecker==0.5.5

Before running the engine please run setup.py. This will download the needed packages for nltk and demoji. Please specify for search_engine.main() the following paramaters: corpus_path - the path to where your data (corpus) is located. output_path - the path to where the posting files and inverted_index dictionary will be saved stemming - boolean indicating if you would like to stemm the terms queries - a list of query strings or a path to a file of queries seperated by new lines num_doc_to_retrieve - number of top relevant documents to retrieve for the query

Name		Name	Last commit message	Last commit date
Latest commit History 59 Commits
__pycache__		__pycache__
venv		venv
GUI.py		GUI.py
README.md		README.md
configuration.py		configuration.py
document.py		document.py
indexer.py		indexer.py
install_conda.bat		install_conda.bat
install_conda.sh		install_conda.sh
instructions.txt		instructions.txt
main.py		main.py
parser_module.py		parser_module.py
python_install.sh		python_install.sh
ranker.py		ranker.py
reader.py		reader.py
run.bat		run.bat
run.sh		run.sh
sample.parquet		sample.parquet
sample2.parquet		sample2.parquet
sample3.parquet		sample3.parquet
search_engine.py		search_engine.py
searcher.py		searcher.py
setup.py		setup.py
stemmer.py		stemmer.py
utils.py		utils.py

yairch/Search_Engine

Folders and files

Latest commit

History

Repository files navigation

Search_Engine

About

Resources

Stars

Watchers

Forks

Languages