forked from robbintt/PythonScraper
-
Notifications
You must be signed in to change notification settings - Fork 0
datajohngraham/PythonScraper
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
JOHN GRAHAM's VERSION 3 This is the full cl_scrape_project, including experimental directories and production tools. The project uses python 2.7.3 with a virtualenv used for installing beautifulsoup4 The virtualenv also had cython and lxml. ###cython lxml? In particular, the raspberry pi virtualenv has been made portable so a reconstruction is no longer necessary when switching between directories. the venv constructor script will construct a virtual environment in the local directory and pip install beautifulsoup4 in that virtual environment. The new lxml parser in beautifulsoup has additional needs: apt-get install libxml2-dev libxslt1-dev python-dev pip install cython pip install lxml these dependencies allow the beautifulsoup soup creator to use the 'lxml' parser, which is much faster.
About
Generic Python Web Scraper
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Python 90.3%
- C 6.3%
- XSLT 3.3%
- Other 0.1%