Python SimpleProcessor.getClassifierTokens Exemples

Exemple #1

Fichier : test_simpleProcessor.py Projet : theseusyang/streamcrab

 def test_getClassifierTokens(self):
     result = SimpleProcessor.getClassifierTokens(
         SimpleProcessor.clean(self.text))
     expect = "hello my name is timor".split()
     self.assertEqual(expect, result)

Exemple #2

Fichier : test_simpleProcessor.py Projet : jimmy0000/streamcrab

 def test_getClassifierTokens(self):
     result = SimpleProcessor.getClassifierTokens(self.text)
     expect = set("hello my name is timor".split())
     self.assertEqual(expect, result)