python3 diffmpm.py

Yuanming Hu, Luke Anderson, Tzu-Mao Li, Qi Sun, Nathan Carr, Jonathan Ragan-Kelley, Frédo Durand

[Paper] [Video] (with instructions to reproduce every demo)

The DiffTaichi differentiable programming framework is now officially part of Taichi. This repo only contains examples.

DiffTaichi significantly boosts the performance and productivity of differentiable physical simulators. For example, the differentiable elastic object simulator (ChainQueen) in DiffTaichi is 188x faster than an implementation in TensorFlow. The DiffTaichi version also runs as fast as the CUDA implementation, with the code being 4.2x shorter.

Most of the 10 differentiable simulators can be implemented within 2-3 hours.

Questions regarding the simulators/autodiff compiler go to Yuanming Hu (yuanming at mit.edu) or Issues.

On August 14 2020, some non-example scripts under examples were moved to examples/misc. These scripts are used to generate figures in the paper, and will not be updated with Taichi anymore. If you want to run them, please use taichi==0.6.26.

Step 1: Install Taichi with pip:

(Most examples do not need a GPU to run.)

python3 -m pip install taichi

Step 2: Run example scripts in the examples folder: (Please wait for all GIFs to load :-)

Gradient descent iteration 0 and gradient descent iteration 80:

Gradient descent iteration 40:

Gradient descent iteration 450:

Gradient descent iteration 180:

Differentiable water simulation + differentiable water rendering + (differentiable) CNN

Optimization goal: find an initial water height field, so that after simulation and shading, VGG16 thinks the squirrel image is a goldfish. Input image: VGG16=fox squirrel (42.21%)

Left: center activation . Right: An activation that fools VGG (VGG16=goldfish (99.91%))

2048 time steps. Gardient descent iteration 20:

682 time steps. Gardient descent iteration 20:

Gardient descent iteration 0 and gradient descent iteration 100:

See the video for the remaining two simulators.

@article{hu2019difftaichi,
  title={DiffTaichi: Differentiable Programming for Physical Simulation},
  author={Hu, Yuanming and Anderson, Luke and Li, Tzu-Mao and Sun, Qi and Carr, Nathan and Ragan-Kelley, Jonathan and Durand, Fr{\'e}do},
  journal={ICLR},
  year={2020}
}
@article{hu2019taichi,
  title={Taichi: a language for high-performance computation on spatially sparse data structures},
  author={Hu, Yuanming and Li, Tzu-Mao and Anderson, Luke and Ragan-Kelley, Jonathan and Durand, Fr{\'e}do},
  journal={ACM Transactions on Graphics (TOG)},
  volume={38},
  number={6},
  pages={201},
  year={2019},
  publisher={ACM}
}