Skip to content

A microservice for downloading and uploading files from cloud storage

License

Notifications You must be signed in to change notification settings

mungujn/downloader-uploader

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

File Uploader, Downloader service

Build Status

codecov

Overview

This service handles the uploading and downloading of files to and from Dropbox. The service exposes 4 endpoints;

  1. POST '/download-job' This endpoint downloads all files located in a Dropbox folder called 'all' and saves them in the working directory in a folder also called 'all'. It returns the data on the newly created download job including a job-id which can be used to check on the completion status of the download job
  2. GET '/download-job/{job-id}' This endpoint returns data on the status of a download job
  3. POST '/upload-job' This endpoint takes a JSON object with an array of classes that were previously classified by the image classifier service. It then looks for folders corresponding to the classes then begins uploading them to Dropbox. It returns a JSON object which includes the ID of the upload job
  4. GET '/upload-job/{job-id}' This endpoint is used for checking on the status of an upload job

Configuring Drop box and running the service

  • Get a token by following the instructions here
  • Set the token as an environment variable
  • Test with pytest, after all tests pass you can start modifying for your own use

This service functions independently, but I built it to work in tandem with the classifier service available here. This downloader and the classifier can be combined and used as a cloud storage image classification system, such as this.

About

A microservice for downloading and uploading files from cloud storage

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages