Skip to content

jasonliw93/recon

Repository files navigation

team03-Project

REsearch Citations in On-line Networks (RECON)

The Report file in git relevant to Phase 4 is in the root and is called Phase4.pdf.

The challenge is to create a application for the researcher Alehanjro that he can use to analyse data about foreign (specifically Israeli) news sources. He wants to see which Twitter Posts(TP) and English News Sources(ENS) are linking to Israeli-English News Sources (INS) and how that link is made. We will use these terms as examples for what the application will do but the application should also work for any kind of website/news source.

Our project will be built on the Django framework using Scrapy to scrape webpages for data.

Installation

Install Python 2.7 - https://www.python.org/downloads/

$ sudo apt-get install libffi-dev libxml2-dev libxslt1-dev libssl-dev python-dev

Ensure that the above libraries are installed. If not running on matlab make sure to do this command.
If on matlab please proceed without running the above command.

$ cd recon_site
$ PATH="$HOME/.local/bin:$PATH"
$ make build

NOTE : Installation takes a long time.

Testing

$ make test

Starting

$ make start
$ make open

Login : admin
Password : admin

Stopping

$ make stop

Build and Run

$ make
$ make open

Prerequisites

Python 2.7
Django 1.7
Scrapy 0.24
Tweepy 2.4 (https://github.com/svven/tweepy.git#egg=tweepy)
Pywb 0.6.3
Warcprox 1.3
Uwsgi 2.0.6
Django-Celery 3.1.16
Django user-accounts 1.0
Django - Jsonfield 0.9.13
Django Eztables 0.3.2
Kombu 3.0.23
Pinax Theme Bootstrap 5.5.1

Packages

libffi-dev
libxml2-dev
libxslt1-dev
libssl-dev
python-dev

Dear User: Are you confused? No idea where to start in our awesome website? Find answers to all your life questions at RECON_User_Manual.pdf, saved under the root directory.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published