#pandas-profiling Generates profile reports from a pandas DataFrame. The df.describe() function is great but a little basic for serious exploratory data analysis.
For each column the following statistics - if relevant for the column type - are presented in an interactive HTML report:
- Essentials: type, unique values, missing values
- Quantile statistics like minimum value, Q1, median, Q3, maximum, range, interquartile range
- Descriptive statistics like mean, mode, standard deviation, sum, median absolute deviation, coefficient of variation, kurtosis, skewness
- Most frequent values
- Histogram
Click here to see a live demo.
You can install using the pip package manager by running
pip install pandas-profiling
Download the source code by cloning the repo or by pressing 'Download ZIP' on this page. Install by navigating to the proper directory and running
python setup.py install
The profile report is written in HTML5 and CSS3, which means pandas-profiling requires a modern browser.
We recommend generating reports interactively by using the Jupyter notebook.
Start by loading in your pandas DataFrame, e.g. by using
import pandas as pd
df=pd.read_csv("/myfilepath/myfile.csv", parse_dates=True, encoding='UTF-8')
To display the report in a Jupyter notebook, run:
pandas_profiling.ProfileReport(df)
If you want to generate a HTML report file, save the ProfileReport to an object and use the to_file() function:
profile = pandas_profiling.ProfileReport(df)
profile.to_file(outputfile="/tmp/myoutputfile.html")
For standard formatted CSV files that can be read immediately by pandas, you can use the profile_csv.py script. Run
python profile_csv.py -h
for information about options and arguments.
- An internet connection. Pandas-profiling requires an internet connection to download the Bootstrap and JQuery libraries. I might change this in the future, let me know if you want that sooner than later.
- pandas (>=0.16)
- matplotlib (>=1.4)