Python PageFetcher 예제들

예제 #1

파일: test_page_fetcher.py 프로젝트: ghoranyi/ats_crawler

class PageFetcherTestSuite(TestCase):

    def setUp(self):
        self.page_fetcher = PageFetcher()

    def test_robots_url_getter(self):
        self.assertEqual("http://pipetop.com/robots.txt", self.page_fetcher._get_robots_file_url("http://pipetop.com"))
        self.assertEqual("http://pipetop.com/robots.txt", self.page_fetcher._get_robots_file_url("http://pipetop.com/"))
        self.assertEqual("http://pipetop.com/robots.txt", self.page_fetcher._get_robots_file_url("http://pipetop.com/customer-cases"))

예제 #2

파일: test_page_fetcher.py 프로젝트: ghoranyi/ats_crawler

 def setUp(self):
     self.page_fetcher = PageFetcher()