Skip to content

Creating a TDE using the Tableau SDK from a Mongo collection (through pyMongo)

Notifications You must be signed in to change notification settings

mkannan-tsi/MongoExtract

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

30 Commits
 
 
 
 
 
 

Repository files navigation

Tableau Extract from MongoDB

Create a TDE using the Tableau SDK from a Mongo collection (through pyMongo)
To use this tool, point it to a collection in your MongoDB instance. It should automatically pick up columns and nested elements such as lists and dictionaries, and flatten them out to create a Tableau Data Extract that can be used for analysis on Tableau.

Blog - https://medium.com/@kannanmadhav/creating-tableau-extracts-from-mongodb-data-fb4887fc5d49

Prerequisites -

• Install pyMongo (https://api.mongodb.com/python/current/)

• Install the following packages - pandas, numpy

• Setup the Tableau SDK for Python (https://onlinehelp.tableau.com/current/api/sdk/en-us/help.htm)

Notes -

• In case of incremental extract, the filter can be added when querying the database using collection.find (line 65), for which syntax can be found at http://api.mongodb.com/python/current/api/pymongo/collection.html#pymongo.collection.Collection.find.

• In case of more than one list, rows will be duplicated and an index is provided for traversing through the resulting matrix.

To try a sample -

• Import the collection 'primer-dataset.json' to your mongo instance, with the below command (without the < or >)-

mongoimport --db <db-name> --collection <collection-name> --drop --file primer-dataset.json –-host <host-name> --port <port-number>

More information at https://docs.mongodb.com/getting-started/shell/import-data/

• Modify the vital details such as host name, port number, db name, collection name, etc.

• Run the script

Acknowledgement -

Flattening JSON logic taken from https://medium.com/towards-data-science/flattening-json-objects-in-python-f5343c794b10

About

Creating a TDE using the Tableau SDK from a Mongo collection (through pyMongo)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages