Python tps Examples

Programming Language: Python

Namespace/Package Name: streamcorpus_pipeline.text_profile_signature

Method/Function: tps

Examples at hotexamples.com: 2

Python tps - 2 examples found. These are the top rated real world Python examples of streamcorpus_pipeline.text_profile_signature.tps extracted from open source projects. You can rate examples to help us improve the quality of examples.

Example #1

Show file

File: test_text_profile_signature.py Project: nithintumma/streamcorpus-pipeline

def test_tps():
    path = os.path.dirname(__file__)
    path = os.path.join( path, _TEST_DATA_ROOT, 'test' )
    text1 = open(os.path.join(path, 'nytimes-index-clean-visible.html')).read().decode('utf8')
    print hashlib.md5(repr(text1)).hexdigest(), tps(text1)
    text2 = open(os.path.join(path, 'nytimes-index-clean-visible-dup.html')).read().decode('utf8')
    print hashlib.md5(repr(text2)).hexdigest(), tps(text2)

Example #2

Show file

def test_tps(test_data_dir):
    path = os.path.join(test_data_dir, 'test')
    text1 = open(os.path.join(path, 'nytimes-index-clean-visible.html')).read().decode('utf8')
    print hashlib.md5(repr(text1)).hexdigest(), tps(text1)
    text2 = open(os.path.join(path, 'nytimes-index-clean-visible-dup.html')).read().decode('utf8')
    print hashlib.md5(repr(text2)).hexdigest(), tps(text2)