Modules in this repository provide support for:
- collecting, parsing, and loading NYC geographic, object-relational data
- santizing, normalizing, parsing, and geocoding street addresses
- using a combination of numerous methods, cross-referencing and linking datasets:
- creating and maintaining up-to-date geographically-linked datasets
- spatial analysis, feature extraction, and some modeling
Most development initially took place on a PostgreSQL server where the data resides, and these modules merely served as paste boards for purposes of redundancy. As a result, much of the early code lacks structure, annotation, and general-purpose utility, i.e., second half of f_postgres.py. Until these functions can be culled and checked for dependencies, they will unfortunately remain part of this repository.
A database dump comprising all the tables affected by this project will become available in the near future. This database is about 500mb and exceeds the 100mb file size limit on github.com.
While not every function will be addressed, there are several noteworthy illustrations that will follow:
- geographic object rendering, feature extraction, and cross-referencing
- lattice implementation
- automatic updating via triggers
- fun example: turnstyles