Horovod Simulation =======

This repository instruments Horovod to gather computation timing estimates for FP and BP layers. It also includes a Python simulator for a ring-allreduce distributed DNN model focusing on network timing.