This is still a WIP and we should be officially open-sourcing the codebase in late June/July 2015. For now, please read the report we published for the TowCenter on our prototype.

git clone https://github.com/newslynx/newslynx.git
cd newslynx
python setup.py install

If you want to actively work on the codebase, install in editable mode:

git clone https://github.com/newslynx/newslynx.git
cd newslynx
pip install --editable . 

Install redis:

brew install redis

NOTE We recommend using Postgres APP. However, if you prefer the brew distribution, make sure to install it with plpythonu.

brew install postgresql --build-from-source --with-python

(Re)create a postgresql database

dropdb newslynx 
createdb newslynx

• fill out example_config/config.yaml and move it to ~/.newslynx/config.yaml
• follow the SQLAlchemy Docs for details on how to configure your sqlalchemy_database_uri.
• Modify default recipes and tags in example_config/defaults/recipes.yaml and example_config/defaults/tags.yaml. These tags and recipes will be created everytime a new organization is added. If you'd simply like to use our defaults, type make defaults. This will move these files to ~/.newslynx/defaults.

Open another shell and run:

redis-server

newslynx init

• In debug mode: newslynx debug
• Debug mode with errors: newslynx debug --raise-errors
• Production gunicorn server: ./run

./start_workers

stop the tasks workers

./stop_workers

This is a result of our extensive use of gevent. We haven't yet figured out how to properly suppress this error. See more details here.

Exception KeyError: KeyError(4332017936,) in <module 'threading' from '/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/threading.pyc'> ignored

• Fix Bulk Loading process.
• Implement Reports API
  • reports are json objects
  • reports can be rendered with Jinja templates
  • reports can be rendered as pdfs
    • see: https://pypi.python.org/pypi/pdfkit or http://stackoverflow.com/questions/23359083/how-to-convert-webpage-into-pdf-by-using-python or just force user s to "save as pdf"
  • reports can be saved + archived up to X days.
  • reports can o
• Re-implement SousChefs
  • RSS Feeds => Thing
  • Google Analytics => Metric
  • Google Alerts => Event
  • Social Shares => Metric
  • Homepage Promotions => Metric
  • Twitter Promotions => Metric
  • Facebook Promotions => Metric
  • Twitter List => Event
  • Twitter User => Event
  • Facebook Page => Event
  • Reddit => Event
  • HackerNews => Event
• Implement New SousChefs
  • IFTTT integrations
    • Wordpress Publish => Thing
    • TK
  • Regex Thing URL => Tag
  • Search Things => Tag
  • Meltwater Emails => Event
  • Newsletter Email Promotions => Metric
  • Calculated Metric? SQL API.
• Implement Recipe scheduler
• Implement Admin Panel
• Migrate Core Prototype Users.
• Automate Deployment
• App Integration
• Document, Document, Document

• http://www.vinaysahni.com/best-practices-for-a-pragmatic-restful-api

• http://www.postgresonline.com/journal/archives/14-CrossTab-Queries-in-PostgreSQL-using-tablefunc-contrib.html

• [http://stackoverflow.com/questions/346132/postgres-how-to-return-rows-with-0-count-for-missing-data]

• http://www.postgresql.org/message-id/AANLkTilsjTAXyN5DghR3M2U4c8w48UVxhov4-8igMpd1@mail.gmail.com

• http://no0p.github.io/postgresql/2014/05/08/timeseries-tips-pg.html

• http://maximebf.com/blog/2012/11/getting-bigger-with-flask/#.VVYvUZNVhBc

• https://github.com/kljensen/async-flask-sqlalchemy-example

• http://flask.pocoo.org/snippets/70/

• http://sqlalchemy-searchable.readthedocs.org/en/latest/configuration.html

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.