Python Spider.scapy Examples

Example #1

File: test.py Project: ruandao/old-python-a-spider-by-ruandao

def test_cls_Spider_scapy__print_OnScapy():
    site = "http://www.hao123.com/"
    max_size = 100
    ptns = producePtns()
    onscapy = print_OnScapy()
    spider = Spider(site,ptns,max_size=max_size,onScapy=onscapy)
    spider.scapy()

Example #2

File: test.py Project: ruandao/old-python-a-spider-by-ruandao

def test_cls_Spider_scapy__logfile_OnScapy():
    site = "http://www.hao123.com/"
    max_size = 100
    logfile = "test_result/logfile"
    ptns = producePtns()
    onscapy = logfile_OnScapy(name=logfile)
    spider = Spider(site,ptns,max_size=max_size,onScapy=onscapy)
    spider.scapy()