Skip to content

[ACM'MM 2020] "MM-Hand: 3D-Aware Multi-Modal Guided Hand Generative Network for 3D Hand Pose Synthesis" Zhenyu Wu, Duc Hoang, Shih-Yao Lin, Yusheng Xie, Liangjian Chen, Yen-Yu Lin, Zhangyang Wang, Wei Fan

VITA-Group/mm-hand

Repository files navigation

Introduction

This repository holds the code for running MM-HAND model as proposed under MM-HAND: 3D-Aware Multi-Modal Guided Hand Generation for Pose Data Augmentation submitted to ACM-MM 2020 conference.

Quick Start

Environment

We tested our code on Ubuntu 19.10, with CUDA 10.1 and Pytorch v1.4.0

  1. clone the current repo
$ git clone https://github.com/ScottHoang/mm-hand.git
$ cd ./mm-hand
  1. create a new pytorch enviroment
  2. Install Pytorch.
  3. Install NVIDIA's APEX following the official link. Don't clone NVIDIA repo in our current directory.
  4. Install dependencies
$ pip install -r requirements.txt

Data

  1. create a datasets folder. Assuming the current directory is this repo
$ mkdir ./datasets
  1. Download Rendered-Hand-Pose dataset
  2. Download Stereo-Tracking dataset
  3. unzip the datasets
  4. run
$ python ./tools/create_STB_DB.py [Path to downloaded STB dataset] ./datasets/stb_dataset 256
$ python ./tools/create_RHD_DB.py [PATH to downloaded RHD dataset] ./datasets/rhd_dataset 256

Run Script

Be sure to read the options that are available within scripts

$ bash ./scripts/mm-train-ratio.sh

Options

Definition

script setup

About

[ACM'MM 2020] "MM-Hand: 3D-Aware Multi-Modal Guided Hand Generative Network for 3D Hand Pose Synthesis" Zhenyu Wu, Duc Hoang, Shih-Yao Lin, Yusheng Xie, Liangjian Chen, Yen-Yu Lin, Zhangyang Wang, Wei Fan

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages