Contains scripts for PropertySuggester to preprocess the wikidata dump

Run the command:

sudo apt-get install build-essential python-pip python-dev
python setup.py install

• use dumpconverter.py to convert a wikidata JSON dump to csv (this can be obtained using extensions/Wikibase/repo/maintenance/dumpJson.php)
• use analyzer.py to create a csv file with the suggestion data that can be loaded into a sql table
• the PropertySuggester extension provides a maintenance script (maintenance/UpdateTable.php) that allows to load the csv into the database

python scripts/dumpconverter.py latest-all.json.bz2 dump.csv
python scripts/analyzer.py dump.csv wbs_propertypairs.csv
php extensions/PropertySuggester/maintenance/UpdateTable.php --file wbs_propertypairs.csv

pytest .

• Restructure repository
• Using pytest instead of nosetests

• Consider classifying Properties
• use Json dumps for analysis

• Generate associationrules for qualifier and references
• Improve ranking to avoid suggestions of human properties
• remove very unlikely rules (<1%)

• Converts a wikidata dump to a csv file with associationrules between properties