Python broadcast_parameters示例

示例#1

文件： controller.py 项目： Terry1504/elasticdl

 def broadcast(self):
     broadcast_parameters(self._model.state_dict(), root_rank=0)
     broadcast_optimizer_state(self._optimizer, root_rank=0)
     self.global_completed_batch_num = broadcast_object(
         self.global_completed_batch_num, name="GlobalCompletedBatchNum")

示例#2

 def sync(self):
     broadcast_parameters(self.model.state_dict(), root_rank=0)
     broadcast_optimizer_state(self.optimizer, root_rank=0)
     super(TorchState, self).sync()

示例#3

文件： state.py 项目： rongou/horovod

 def sync(self):
     broadcast_parameters(self.value.state_dict(), root_rank=0)