This repo hosts the Docker Volume Driver for vSphere. Docker Volume Driver enables customers to address persistent storage requirements for Docker containers in vSphere environments. This plugin is integrated with Docker Volume Plugin framework. Docker users can now consume vSphere Storage (vSAN, VMFS, NFS) to address persistency requirements of containerized cloud native apps using Docker Ecosystem.

To read more about code development and testing please read CONTRIBUTING.md as well as the FAQ on the wiki.

[Click here to download (Github releases)] (https://github.com/vmware/docker-volume-vsphere/releases).

The download consists of 2 parts

1. ESX: The ESX code is packaged as a [vib or an offline depot] (http://pubs.vmware.com/vsphere-60/index.jsp#com.vmware.vsphere.install.doc/GUID-29491174-238E-4708-A78F-8FE95156D6A3.html#GUID-29491174-238E-4708-A78F-8FE95156D6A3)
2. VM Running Docker: The docker plugin is packaged as a deb or rpm file.
   • Photon => Download RPM
   • Ubuntu => Download Deb.

Please pick the latest release and use the same version of ESX and VM release.

The demos are located on the project wiki

Documentation, FAQ and other content can be found @ https://vmware.github.io/docker-volume-vsphere

Install vSphere Installation Bundle (VIB). Please refer to vSphere documentation.

Install using localcli on an ESX node

esxcli software vib install --no-sig-check  -v /tmp/<vib_name>.vib

Make sure you provide the absolute path to the .vib file or the install will fail.

The Docker volume plugin requires the docker engine to be installed as a prerequisite. This requires Ubuntu users to configure the docker repository and pull the docker-engine package from there. Ubuntu users can find instructions here.

[Docker recommends that the docker engine should start after the plugins.] (https://docs.docker.com/engine/extend/plugin_api/)

sudo dpkg -i <name>.deb # Ubuntu or deb based distros
sudo rpm -ivh <name>.rpm # Photon or rpm based distros

$ docker volume create --driver=vmdk --name=MyVolume -o size=10gb
$ docker volume ls
$ docker volume inspect MyVolume
$ docker run --rm -it -v MyVolume:/mnt/myvol busybox
$ cd /mnt/myvol # to access volume inside container, exit to quit
$ docker volume rm MyVolume

$ /usr/lib/vmware/vmdkops/bin/vmdkops_admin.py ls

The volume plugin needs to be started up before starting docker.

service docker stop
service docker-volume-vsphere restart
service docker start

using systemctl

systemctl stop docker
systemctl restart docker-volume-vsphere
systemctl start docker

The relevant logging for debugging consists of the following:

• Docker Logs
• Plugin logs - VM (docker-side)
• Plugin logs - ESX (server-side)

Docker logs: see https://docs.docker.com/engine/admin/logging/overview/

/var/log/upstart/docker.log # Upstart
journalctl -fu docker.service # Journalctl/Systemd

VM (Docker-side) Plugin logs

• Log location: /var/log/docker-volume-vsphere.log
• Config file location: /etc/docker-volume-vsphere.conf.
• This JSON-formatted file controls logs retention, size for rotation and log location. Example:

 {"MaxLogAgeDays": 28,
 "MaxLogSizeMb": 100,
 "LogPath": "/var/log/docker-volume-vsphere.log"}

• Turning on debug logging: stop the service and manually run with ``--log_level=debug` flag

ESX Plugin logs

• Log location: /var/log/vmware/vmdk_ops.log
• Config file location: /etc/vmware/vmdkops/log_config.json See Python logging config format for content details.
• Turning on debug logging: replace all 'INFO' with 'DEBUG' in config file, restart the service

VMware ESXi:

• 6.0
• 6.0 u1
• 6.0 u2

Docker: 1.9 and higher

Guest Operating System:

• [Photon 1.0] (https://vmware.github.io/photon/) (Includes open-vm-tools)
• Ubuntu 14.04 or higher (64 bit)
  • Needs Upstart or systemctl to start and stop the plugin
  • Needs open vm tools or VMware Tools installed sudo apt-get install open-vm-tools
• RedHat and CentOS

1. Operations are serialized. Thus, if a large volume is created, other operations will block till the format is complete. #35
2. VM level snapshots do not include docker data volumes. #60
3. Exiting bug in Docker around cleanup if mounting of volume fails when -w command is passed. [Docker Issue #22564] (moby/moby#22564)
4. VIB, RPM and Deb files are not signed.#273
5. Pre-GA releases of Photon can crash on attaching a Docker volume. This issue is resolved in Photon Issue 455 (Photon GA). Workaround: power off the Photon VM, change SCSI Adapter type from LSI Logic to PVSCSI, and power on the VM.

• [cna-storage@vmware.com](cna-storage cna-storage@vmware.com)
• [Telegram] (https://telegram.me/cnastorage)
• [Issues] (https://github.com/vmware/docker-volume-vsphere/issues)

• [VMware Internal Slack] (https://vmware.slack.com/archives/docker-volume-vsphere)