Take a huge data set from Seattle Gov and use HDInsight 'Hadoop' to query the data and then either model it or use it for predictive analytics and/or machine learning.
- DO NOT apply Azure passes for current subscriptions 'will invalidate the pass'
- We MUST USE the tools demoed, HDInsight to consume the data and PowerBI to visualize
| First Name | Last Name | |
|---|---|---|
| Joubin | Jabbari | joubin.j@gmail.com |
| Steven | Brower | sbrower@vt.edu |
| Dustin | Arendt | Dustin.Arendt@gmail.com |
| Chris | Carpenter | Chris@bienabee.com |
| Louis | Tadman | Louis@bienabee.com |
Data Sources from Seattle Gov
- Land Use Permits
- Building Permits
- Seattle Police Department 911 Incident Response
- Public Outreach and Engagement Events
- My Neighboprhood Map 'Community Amenities'
These are general notes and ideas from interesting topics and discussions with other hackathon members
- Link to Hadoop and to HDInsight
- HDInsight is Hadoop as a service on the Azure platform
- HDInsight on Azure has blob storage for saving and preserving data once your Azure platform is spun down
- Every HDInsight cluster must have a head node and data nodes
- Azure has a Machine Learning platform
- Example of machine learnign is mail sorting alrogythms that learns multiple different handwriting styles and is able to understand and process addresses
- Kinect has machine Learning, a lot of current MSFT software has machine learning
- R & Python are good languages to use for machine kearnng programming
- To process data with Azure machine learning the data must be in Azure 'HDInsight' for example
- Uses RESTful API and deals with JSON data
- PowerBI can be used for free and accessed at PowerBI
- PowerBI has excellent integration with iPhones by using the Microsoft PowerBI application
- You can use the PowerBI Designer as a canvas to create your report visualizations
