Scripts to monitor Twitter and manage Tweet and User data.

If not already present, install RethinkDB.

Install also the needed dependencies for the scripts to work.

pip3 install -r requirements.txt

Register your application at apps.twitter.com to get your API keys needed to communicate with the Twitter API.

Edit tweepy_conf.py and paste your application keys and secrets.

db_conf.py stores the database config. Edit if you need to.

Make sure your RethinkDB database server is running and your database and tables are properly configured. Run the server part of Twilytic once to have the database, tables and indexes automatically created.

Run the scripts with Python 3.

Fetches all German parliament representatives based on the Twitter lists of the official party accounts. Secondly, classify them with keywords included in the processed Twitter lists the individual users are listed in. Write them finally into the database.

Connect to Twitter's Streaming API, monitor the collected users and write Tweets into the database.

Update like and retweet counts from Tweets in the database. Edit the minuteCount variable to update all Tweets that were posted minuteCount from now.

Update user data from users in the database. Fields such as profile picture, description, name etc. will be updated.

Delete all Tweets older than 30 days.

To make Twilytic work, you also need to install, configure and run twilytic-server and twilytic-client.

Twilytic is the outcome of my Master's thesis at the Technical University of Munich. The thesis was issued and supervised by Prof. Dr. Jürgen Pfeffer from the chair of Computational Social Science and Big Data. Thank you so much!