Skip to content

showhelloworld/scrapy-insights

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Scrapy-Insights

A simple python application to scrape a Facebook page and collect insights about the posts on the page.

Installation

  1. Create a virtual environment for the project: mkvirtualenv scrapy-insights
  2. Install requirements: pip install requirements.txt

Running the application

You will need a Facebook access token with the read_insights and manage_pages permissions, as well as the Facebook Page ID (found via Page > Settings > Page Info > Facebook Page ID).

Then, just run this command:

scrapy crawl page -a page=<PAGE_ID> -a token=<PAGE_TOKEN>

Then, insights for that pages posts will be collected and sent to RabbitMQ.

RabbitMQ configuration can be found in insights/settings.py.

Notes

Due to time constraints, the following features have been omitted

  • Tests
  • Handling Facebook Pagination

About

A scraper which scrapes the facebook insights API

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%