Python tier_tokens Examples

Example #1

File: heur_tests.py Project: rgeorgi/intent

    def test_direct_pos_heur(self):
        gloss_pos = tier_tokens(create_words_tier_from_string('NOUN PRON VERB DET'))
        trans_pos = tier_tokens(create_words_tier_from_string('NOUN VERB DET NOUN'))

        h = heur_alignments(self.gloss_tokens, self.trans_tokens, gloss_pos=gloss_pos, trans_pos=trans_pos).flip()
        self.assertEqual(self.a2, h)

Example #2

File: tests.py Project: rgeorgi/intent

    def test_add_pos_tags(self):
        add_pos_tags(self.igt, 'gw', self.tags)

        self.assertEquals(tier_tokens(pos_tag_tier(self.igt, 'gw')), self.tags)