Python get_bert_optimizer示例

示例#1

文件： bert_classifier.py 项目： youngshingjun/ParlAI

 def init_optim(self, params, optim_states=None, saved_optim_type=None):
     """
     Initialize the optimizer.
     """
     self.optimizer = get_bert_optimizer([self.model],
                                         self.opt['type_optimization'],
                                         self.opt['learningrate'])

示例#2

文件： bert_transformer_generator.py 项目： SirChoeg/ParlAI

 def init_optim(self, params, optim_states=None, saved_optim_type=None):
     self.optimizer = get_bert_optimizer([self.model],
                                         self.opt['type_optimization'],
                                         self.opt['learningrate'],
                                         fp16=self.opt.get('fp16'))