Skip to content

toaf951023/Python_compendium

 
 

Repository files navigation

* The Python compendium

This folder contains several scripts, notes and examples elaborated through many nights of coding (hopefully they'll be useful in future references). N.B. highly encouraged to recycle and make use of them in any possible way. More elaborated examples may be found in the astro/cosmo folders within this GitHub account.

As you can see from below, Python is the dominant language, however due to the popularity of R I have added some standard notes, visualizations and basic statistics examples. There are also several SQL examples, based on SQLite and MYSQL, that have been tested with Pandas. Finally, to integrate HTML, CSS, JS with Python and SQL, I included some files to create websites using Flask.

The majority of the content may be found spread around the web or throughout several books, but the bibliography I used, and possibly where all the info is coming from, is displayed on the bottom of the page.

x - means that I haven't had a chance to spend a considerable amount of time in that particular topic, but I am about to.

Before starting, have a look of Git: A simple guide for getting started with git and Git-SVN: Git - SVN Crash Course.


Python

Getting data

  • Scraping the web: (Beatiful Soup, requests).
    • O'Reilly Media: Plotting books published over the 'data' subject.
    • Yellow Pages: Get info for Coffee shops in NYC.
  • Scraping the web II: (Parse, urlopen).
    • Yahoo's finance, Options. Long Island Rail Road (XML).
  • Using Twython API: Getting tweets with hashtag (i.e. Data).
  • Searching for Quasars(Mechanize).
    • Building a catalog of selecting qusars for the sdss collaboration.

Working with data

R

Visualization

SQL

Machine Learning, Stats and other magic tricks

Parallel Computing

Web

  • Flask: Flask using Bokeh for visualizations.
  • Flask Frozen: Flask_frozen and flask_pages to create a static website


Lecture notes - Python



* Conferences



* Bibliography

Data scraping

Data wrangling

  • Pandas: Provides high-performance, easy-to-use data structures and data analysis tools.
  • Pandas Cookbook Gives concrete examples for getting started with pandas.

Statistics and Probability

  • Scipy: SciPy is a Python-based ecosystem of open-source software for mathematics, science, and engineering.
  • Statsmodels: Provides classes and functions for the estimation of many different statistical models.
  • Scikit-learn: Machine Learning in Python
  • Astropy

Databases

R

Visualizations

  • Matplotlib: python 2D plotting library.
  • Seaborn: It provides a high-level interface for drawing attractive statistical graphics.
  • Basemap: Great tool for creating maps using python in a simple way.
  • Bokeh: Brings D3- style visualization into Python.
  • D3: Sophisticated interactive visualizations for the web (however not for python).
  • ggplot: Python port of the popular R library ggplot2.
  • Chaco and Mayavi: It works well for interactive data visualization and exploration (2D and 3D).
  • Lightning: Provides API-based access to reproducible web visualizations.

Flask

APIs

Miscellaneous

  • Enaml: For creating professional quality user interfaces with minimal effort.
  • PyQwt: It provides a widget to plot 2-dimensional data.
  • Binder: Turn a GitHub repo into a collection of interactive notebooks.
  • Searchcode: Google for coding.
  • Virtual Enviroment: Create virtual environments for python with conda.
  • Jinja2: Template Designer Documentation
  • Bootstrap: Global CSS settings


* Webpages worthwhile reading



About

Nights for coding

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 86.7%
  • HTML 12.4%
  • R 0.6%
  • Python 0.3%
  • TeX 0.0%
  • PLpgSQL 0.0%