Skip to content

dancaspi/redshift-unloader2

 
 

Repository files navigation

redshift-unloader

Unloads the result of a query on Amazon Redshift to local storage.

Prerequisites

  • Python 3.6+
  • boto3 1.7.84
  • psycopg2 2.7.5
  • psycopg2-binary 2.7.5

Installation

The package is available on PyPI:

pip install redshift-unloader

Usage

Unloaded data is supposed to be gzipped.

from redshift_unloader import RedshiftUnloader

ru = RedshiftUnloader(host='<redshift host>',
                      port=<redshift port>,
                      user='<redshift user>',
                      password='<redshift password>',
                      database='<redshift database name>',
                      s3_bucket='<s3 bucket name>',
                      access_key_id='<aws access key id>',
                      secret_access_key='<aws secret access key>',
                      region='<aws region>',
                      verbose=False)

ru.unload("SELECT * FROM my_table WHERE log_time >= 'yyyyMMdd'",
          "/path/to/result.csv.gz",
          delimiter=',',
          add_quotes=True,
          escape=True,
          null_string='',
          with_header=True)

About

Unload utility for Amazon Redshift

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 100.0%