Skip to content

A simple scraper to save out HTML for the top search result of each retailer using rewardstyle's api

Notifications You must be signed in to change notification settings

singlerider/rewardstyle_scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Rewardstyle Basic Scraper

Python 2.7.x

Installation

Setting up a virtual environment (ideally), installing dependencies, and gaining credentials.

Make sure to make a config file to place your credentials:

cp config_example.py config.py

Virtual Environment

I would recommend running this in a virtual environment to keep your dependencies in check. If you'd like to do that, run:

sudo pip install virtualenv

Followed by:

virtualenv venv

This will create an empty virtualenv in your project directory in a folder called "venv." To enable it, run:

source venv/bin/activate

and your console window will be in that virtualenv state. To deactivate, run:

deactivate

Dependencies

To install all dependencies locally (preferably inside your activated virtualenv), run:

pip install -r requirements.txt

To Run

Run

./app.py

or

python app.py

To-do

Improve analytics module

About

A simple scraper to save out HTML for the top search result of each retailer using rewardstyle's api

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages