GitHub - sebneu/doingdatascience

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 5 Commits
.gitignore		.gitignore
README		README
col_stats.json		col_stats.json
column_classifier.py		column_classifier.py
column_types.csv		column_types.csv
numeric data.py		numeric data.py
numeric_testdata.txt		numeric_testdata.txt

Repository files navigation

'column_types.csv' lists the (heuristic) types of all columns:
- 'file': path to the CSV file
- 'column': the index of the respective column (starting with 0)
- 'type': the heuristically determined type (NUMERIC, ENTITY, TEXT, ID)
- 'avg_tokens': the count of words which appears most in the column values (e.g., if 2 most of the cells have 2 words)