This project contains helpers used at the ENSAE for teachings available at ENSAE - Programmation - Xavier Dupré.
- retrieve data for practical lessons
- import a tsv file into a database
- retrieve stock prices from Yahoo Finance
- magic commands to easily use SQLite3 from a notebook
- magic commands to access a Cloudera Cluster and run PIG jobs
- magic commands to access Azure Blob Storage and HDInsight
- magic commands to display content of a folder in DataFrame
Class StockPrices requires:
Class ASSHClient requires:
Class AzureClient requires:
The function register_magics defines magic commands to send commands to a remote commands through a SSH connection:
%remote_open
,%remote_close
%remote_cmd
,%remote_up
,%remote_down
The magic commands will be automatically enabled if the module is imported from a notebook.
Started in 2013/08.
- First contributor: Xavier Dupré.
- Others contributors: ENSAE's students.
- 1.1 - 2015/??/??
- change: magic command
%tail_stderr
nows displays keywordERROR
in red. - new: magic command
%blob_downmerge
to download the content of a folder from a blob storage - add: method pyensae.remote.remote_connection_ssh.ASSHClient.upload_cluster
- add: method pyensae.remote.remote_connection_ssh.ASSHClient.download_cluster
- add: add magic command to test a streaming script for PIG
- add: function pyensae.file_helper.content_helper.file_head, pyensae.file_helper.content_helper.file_tail
- add: add magic command
%lsrepo
,%compress
,%mpl_style
- del: delete class TransferFTP, moves it to module pyquickhelper
- add: add magic command
%hhelp
to display the help for an object in HTML format - new: function pyensae.graph_helper.graphviz_helper.run_dot
- change: update to antlr 4.5, add CSharp grammar
- new: new magic command
textdiff
- new: new magic command
nb_menu
to display a menu from all available section in the notebook - new: function Corrplot copied from module biokit (works in python 3)
- change: magic command
- 1.0 - 2014/11/10
- add: add magic command
%tail_stderr
for class AzureClient - add: add magic commands for SQLite3 + a notebook
- fix: the setup does not need the file
README.rst
anymore - new: magic commands
%lsr
to retrieve the content of a folder - new: various function to format the size of a file
- add: add magic command