Skip to content

GuillaumeSalhaGalvan/pyensae

 
 

Repository files navigation

README / Changes

Build status

image

PYPI Package

GitHub Issues

MIT License

Links:

Description

This project contains helpers used at the ENSAE for teachings available at ENSAE - Programmation - Xavier Dupré.

Functionalities

  • retrieve data for practical lessons
  • import a tsv file into a database
  • retrieve stock prices from Yahoo Finance
  • magic commands to easily use SQLite3 from a notebook
  • magic commands to access a Cloudera Cluster and run PIG jobs
  • magic commands to access Azure Blob Storage and HDInsight
  • magic commands to display content of a folder in DataFrame

Dependencies

Class StockPrices requires:

Class ASSHClient requires:

Class AzureClient requires:

The function register_magics defines magic commands to send commands to a remote commands through a SSH connection:

  • %remote_open, %remote_close
  • %remote_cmd, %remote_up, %remote_down

The magic commands will be automatically enabled if the module is imported from a notebook.

Contributions

Started in 2013/08.

  • First contributor: Xavier Dupré.
  • Others contributors: ENSAE's students.

Versions

  • 1.1 - 2015/??/??
    • change: magic command %tail_stderr nows displays keyword ERROR in red.
    • new: magic command %blob_downmerge to download the content of a folder from a blob storage
    • add: method pyensae.remote.remote_connection_ssh.ASSHClient.upload_cluster
    • add: method pyensae.remote.remote_connection_ssh.ASSHClient.download_cluster
    • add: add magic command to test a streaming script for PIG
    • add: function pyensae.file_helper.content_helper.file_head, pyensae.file_helper.content_helper.file_tail
    • add: add magic command %lsrepo, %compress, %mpl_style
    • del: delete class TransferFTP, moves it to module pyquickhelper
    • add: add magic command %hhelp to display the help for an object in HTML format
    • new: function pyensae.graph_helper.graphviz_helper.run_dot
    • change: update to antlr 4.5, add CSharp grammar
    • new: new magic command textdiff
    • new: new magic command nb_menu to display a menu from all available section in the notebook
    • new: function Corrplot copied from module biokit (works in python 3)
  • 1.0 - 2014/11/10
    • add: add magic command %tail_stderr for class AzureClient
    • add: add magic commands for SQLite3 + a notebook
    • fix: the setup does not need the file README.rst anymore
    • new: magic commands %lsr to retrieve the content of a folder
    • new: various function to format the size of a file

About

teaching materials in python at the ENSAE

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 95.7%
  • ANTLR 4.3%