Python TextAnalyser._preprocess примеры использования

Пример #1

Файл: text_analysis_tests.py Проект: nihaofuyue0617/pythia

 def test_text_preprocessing(self):
     text = "This is a sample text. # ! . "
     analyser = TextAnalyser()
     processed = analyser._preprocess(text)
     expected = ('This is a sample text. # ! . ', ['sampl',
                                                   'text'], [('sampl', 1),
                                                             ('text', 1)])
     self.assertEqual(expected, processed)

Пример #2

Файл: text_analysis_tests.py Проект: aurora1625/pythia

 def test_text_preprocessing(self):
     text = "This is a sample text. # ! . "
     analyser = TextAnalyser()
     processed = analyser._preprocess(text)
     expected = ('This is a sample text. # ! . ', ['sampl', 'text'], [('sampl', 1), ('text', 1)])
     self.assertEqual(expected, processed)