Python Scraper.get_page_as_soup Examples

Programming Language: Python

Namespace/Package Name: Scrapers

Class/Type: Scraper

Method/Function: get_page_as_soup

Examples at hotexamples.com: 2

Python Scraper.get_page_as_soup - 2 examples found. These are the top rated real world Python examples of Scrapers.Scraper.get_page_as_soup extracted from open source projects. You can rate examples to help us improve the quality of examples.

Frequently Used Methods

Show Hide

__init__(2)

get_page_as_soup(2)

get_links_from_soup(1)

links_to_chapters(1)

scrape_chapter_contents(1)

Example #1

Show file

File: TestScrapers.py Project: Ampersandnz/TLAScraper

 def test_get_page_as_soup_not_null(self):
     self.assertIsNotNone(Scraper.get_page_as_soup(self.GOOGLE_URL))

Example #2

Show file

File: TestScrapers.py Project: Ampersandnz/TLAScraper

 def test_links_to_chapters(self):
     soup = Scraper.get_page_as_soup(self.GOOGLE_URL)
     chapters = Scraper.get_links_from_soup(soup)
     self.assertIsNotNone(chapters)
     self.assertEqual(21, len(chapters))