Exemplos de AlbertForMaskedLM.save_pretrained em Python

Exemplo n.º 1

Arquivo: convert_tfmodel_to_pytorch.py Projeto: alicika/albert-japanese

def main(args):
    with open(args.config) as fp:
        data = json.loads(fp.read())
    config = AlbertConfig(**data)
    model = AlbertForMaskedLM(config)
    model: AlbertForMaskedLM = load_tf_weights_in_albert(model, config, args.checkpoint)
    model.save_pretrained(args.output)

Exemplo n.º 2

Arquivo: convert_tfmodel_to_pytorch.py Projeto: yykozy/albert-japanese

def main(args):
    with open(args.config) as fp:
        data = json.loads(fp.read())
    config = AlbertConfig(**data)
    model = AlbertForMaskedLM(config)
    model: AlbertForMaskedLM = load_tf_weights_in_albert(
        model, config, args.checkpoint)
    model.save_pretrained(args.output)

    tokenizer = AlbertTokenizer.from_pretrained(args.spiece, keep_accents=True)
    tokenizer.save_pretrained(args.output)