• copy .env.sample to .env
• then pipenv install
• pipenv shell

• Following instructions from
• docker run --name humaniki-mysql -e MYSQL_ROOT_PASSWORD=my-secret-pw -p 3306:3306 -v /data/project/denelezh:/data/project/denelezh -d mysql:latest
  • note on Mac OSX: in new OSX's you can't make a user-defined directory in root, so you will need to mount your volumes more like -v /Uesrs/me/data:/Users/me/data
• docker exec -it humaniki-mysql bash
• mysql -uroot -h localhost -p #from inside the docker container
• CREATE DATABASE humaniki DEFAULT CHARACTER SET 'utf8mb4';
• CREATE USER 'humaniki'@'localhost' IDENTIFIED BY 'xxxxxxx'; #exclude identified by for brew no password #use "IDENTIFIED WITH ; #exclude identified by for brew no password
• GRANT ALL ON humaniki.* TO 'humaniki'@'localhost';
• GRANT ALL ON humaniki.* TO 'humaniki'@'127.0.0.1'; #double check for 172.17.0.1 aka docker container IP address
• GRANT FILE on . to 'humaniki'@'localhost';

-docker start some-mysql

in /etc/mysql/my.cnf (you may have to add a [mysqld] section) secure-file-priv= /data/project/denelezh

• pre req sudo apt-get install libmysqlclient-dev

• git clone humaniki-schema<as git link>

• pipenv install

• alembic init alembic or cp alembic.ini.sample alembic.ini
• alembic upgrade head

• python generate_insert.py directly

docker start some-mysql

• apparently they don't play well together so you may need to do inside of a pipenv shell
• pip install apache-airflow==1.10.13

due to wiketech labs config, storing code at /srv/humaniki

1. most example data came from querying an old version of denelezh, until that very inopportunely went down. then I used Wikdiata Query service to create
2. country labels and iso codes
3. and occupations

#List of present-day countries and capital(s)
SELECT DISTINCT ?country ?countryLabel ?iso_3166_1
WHERE
{
  ?country wdt:P31 wd:Q3624078 .
  #not a former country
  FILTER NOT EXISTS {?country wdt:P31 wd:Q3024240}
  #and no an ancient civilisation (needed to exclude ancient Egypt)
  FILTER NOT EXISTS {?country wdt:P31 wd:Q28171280}
  ?country wdt:P297 ?iso_3166_1 .

  SERVICE wikibase:label { bd:serviceParam wikibase:language "fr" }
}
ORDER BY ?countryLabel

SELECT distinct ?occupation ?occupationLabel
WHERE
{
  ?occupation wdt:P31 wd:Q12737077
  SERVICE wikibase:label { bd:serviceParam wikibase:language "fr". }
}
limit 2000

#     public static final String ITEM_GENDER_IDENTITY = "Q48264";
#     public static final String ITEM_SEX_OF_HUMANS = "Q4369513";
# 
SELECT DISTINCT ?gender ?genderLabel ?lang
WHERE
{
  ?gender wdt:P31 wd:Q48264.
  
  BIND("en" as ?lang).

 
  SERVICE wikibase:label { bd:serviceParam wikibase:language "en" }
}
ORDER BY ?genderLabel

• If you can't connect to database check if docker container is running
• docker ps -If the container isn't running you need to run the following: -docker start humaniki-ql
• You should see an entry to some-mysql

-Then try to connect to my-sql using the command line client with the humaniki user -mysql -uhumaniki -h 127.0.0.1

-To run flask app: -Add configuration for file: python app -pipenv shell #loads our specific python with .env environment variables -python humaniki_backend/app.py #runs the flask app entry point -or just run the configuration from PyCharm

maximilianklein@humaniki:~$ sudo -- sudo -iu humaniki

• craete a webproxy on horizon
• run gunicorn --bind unix:humaniki.sock -mXXX -t 60 wsgi:app from humaniki-backend (running in a screen for now)
• config location / { include proxy_params; proxy_pass http://unix:/home/humaniki/humaniki-backend/humaniki.sock;}

• sshfs humaniki-prod:/mnt/nfs/dumps-labstore1007.wikimedia.org/ ~/public