Python file_handle_to_s3 Examples

Example #1

File: test2-dag.py Project: bmedx/analytics-pipeline-rubric

def upload_data_to_s3(data):
    """
    Uploads our randomly generated dataframe to S3 and returns the S3 file handle
    """
    filename = 'foo.csv'
    data.to_csv(filename, index=False)

    with open(filename, 'rb') as fh:
        materialization, s3_handle = file_handle_to_s3(fh)

    yield s3_handle

Example #2

File: test_file_handle_to_s3.py Project: laudehenri/dagster

 def test():
     return file_handle_to_s3(emit_temp_handle())