Hosting and storing multiple small files in a single larger file-container (reducing multiple file open actions). Prove of concept.

• first results: 111Kb files load in ~800ms (rather slow)

Prerequisites

• Python 2.7
• pip
• virtualenv
• uwsgi

Create volumes

Create storage volumes for dfs, this will not overwrite existing files (by default, -f flag will overwrite).

./script/dfs init <target> <size_in_mb>

Upload file

Uploading multiple files through curl (example)

curl -iX POST http://localhost:5000/file/append -F "file[]=@path_to_file.ext" -F "file[]=@path_to_file2.ext"

Running Local Server

./script/dfs serve <target>

Running wsgi server

TODO: add config options

uwsgi configs/wsgi.yml

Nginx config

• stub