Python crawl Examples

Programming Language: Python

Namespace/Package Name: crawler.selfbank.market_crawler

Method/Function: crawl

Examples at hotexamples.com: 4

Python crawl - 4 examples found. These are the top rated real world Python examples of crawler.selfbank.market_crawler.crawl extracted from open source projects. You can rate examples to help us improve the quality of examples.

Example #1

Show file

File: market_crawler.py Project: macvaz/stocks

    def test_crawl_NYSE(self):
        lse = Market.objects.get(symbol='NYSE')

        before = PageUrl.objects.count()
        crawl(lse)
        after = PageUrl.objects.count()

        self.assertTrue(after - before == 73, "Number of pages mitmatch!")

Example #2

Show file

File: market_crawler.py Project: macvaz/stocks

 def test_crawl_NYSE(self):
     lse = Market.objects.get(symbol='NYSE')
     
     before = PageUrl.objects.count()
     crawl(lse)
     after = PageUrl.objects.count()
     
     self.assertTrue(after - before == 73, "Number of pages mitmatch!")

Example #3

Show file

File: market_crawler.py Project: macvaz/stocks

    def test_crawl_IGBM(self):
        igbm = Market.objects.get(symbol='IGBM')

        before = PageUrl.objects.count()
        crawl(igbm)
        after = PageUrl.objects.count()

        self.assertTrue(after - before == 1, "Number of pages mismatch!")

Example #4

Show file

File: market_crawler.py Project: macvaz/stocks

 def test_crawl_IGBM(self):
     igbm = Market.objects.get(symbol='IGBM')
     
     before = PageUrl.objects.count()
     crawl(igbm)
     after = PageUrl.objects.count()
     
     self.assertTrue(after - before == 1, "Number of pages mismatch!")