Skip to content

AlinaZakharova1997/Tokenizator

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

165 Commits

ML practical 01.ipynb

ML practical 01.ipynb

 
 

README.md

README.md

 
 

Topic_model_gensim_sklearn.ipynb

Topic_model_gensim_sklearn.ipynb

 
 

indexer.py

indexer.py

 
 

my_server.py

my_server.py

 
 

search.py

search.py

 
 

search_Tolstoy.py

search_Tolstoy.py

 
 

test.py

test.py

 
 

test_Tolstoy.py

test_Tolstoy.py

 
 

test_indexator.py

test_indexator.py

 
 

test_search.py

test_search.py

 
 

test_windows.py

test_windows.py

 
 

tokenizator.py

tokenizator.py

 
 

windows.py

windows.py

 
 

Копия_блокнота_"Topic_model_BigARTM_ipynb".ipynb

Копия_блокнота_"Topic_model_BigARTM_ipynb".ipynb

 
 

Repository files navigation

Tokenizator

This module performs the morphological analyses of a text and extracts tokens. Tokens here are words or letters As a result it returns a list of tokens and a position of the first element of each token.

About

No description, website, or topics provided.

Resources

Readme
Activity

Stars

0 stars

Watchers

2 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages