Пример #1
0
 def tokenStream(self, analyzer: Analyzer):
     return analyzer.tokenStream(self.name(), [self.text])
Пример #2
0
 def tokenStream(self, analyzer: Analyzer):
     return analyzer.tokenStream(self.name(), self.contents)