• Beautiful Soup 4
• Python 2.7

pip install beautifulsoup4

Using Beautiful Soup 4 and Urllib for Web Scraping using Multi and Single Thread

The getting_familiar file has a few commands you can play with on the Wikipedia home page that culminates in finding all of the Featured Article Links on the Wikipedia Homepage.

Basic single thread example of scraping the top x number of poems off of Hello Poetry

• Note that there are a max of seven poems

Multi-threaded example of scraping the top x number of poems off of Hello Poetry

• Note that there are a max of seven poems