A collection of Python scripts helping to generate some open data packages for https://www.avoindata.fi/fi

https://avoindata.prh.fi/ytj.html

• Scripts that get the data of all active Finnish companies of the following company forms:

  • limited liability companies
  • public limited companies
  • housing companies
  • co-operatives
  • insurance companies
  • public insurance companies

• Output formats:

  • csv
  • json

• Note: for the script to work, it needs to have json data. Please store the json data in data/json/prh_data/YEAR/

Note that running this scripts takes days in its full extent. This is because PRH has limited the usage of their API to 300 queries per minute total for all users. The size of the total dataset is almost 3 GB

• A script that gets data from PRH's company API from 1978 to 2017
• It makes a query based on the following parameters:
  1. A company registration time period defined as one month
  2. Business line code as defined by Statistics Finland: http://tilastokeskus.fi/meta/luokitukset/toimiala/001-2008/index_en.html
• The data is saved on: data/json/prh_data

• A script that iterates through all the json files downloaded by the get_prh_data.py and makes a csv of them
• Companies that do not exist anymore are ignored. These are identified by finding a trade register note with the description 'Ceased' or 'Lakannut' (in Finnish).

• Newly registered companies can be identified by running the get_prh_data.py script for the current period
• Lately ceased companies can be identified by querying the 'Finnish trade register's public notices' API: https://avoindata.prh.fi/tr_en.html

Scripts related to the postcodes open data set found in https://www.avoindata.fi/data/fi/dataset/postcodes

• The scripts enhance the existing open data set with these two functionalities:
  1. transforms .opt files to the more common .csv format from the dataset: https://www.avoindata.fi/data/fi/dataset/rakennusten-osoitetiedot-koko-suomi
  2. appends the globally common WGS84 coordinates to the data in addition to the Finnish ETRS standard

• This script is the real work horse. It reads OPT's and outputs csv with the WGS coordinates appended
• Note: for the script to work, it needs to have OPT data. Please store the opt data in data/opt/postcodes

• A script that finds erroneous data in the original dataset
• It searches for lacking:
  • Postcodes
  • Municipalities
  • Provinces
  • Addresses

• functions for handling multiple files at once and a geo conversion accuracy tester

A script that gets the amount of connections organizations have to the National Data Exchange Layer (KAPA)

• This scripts scrapes the liityntakatalogi website and writes the amount of connections to an CSV file