saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-30 20:18:08 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Fix typo in BERT pretraining script (#6175)

Browse source 
A misplaced `}` meant that the `'enable_adasum'` option was interpreted incorrectly, causing the test to fail.
This commit is contained in:
Derek Murray 2020-12-18 16:38:14 -08:00 committed by GitHub
parent bbb52e9274
commit 11b0a5401e
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
orttraining/orttraining/test/python/orttraining_run_bert_pretrain.py
View file

@ -437,8 +437,8 @@ def prepare_model(args, device):
'world_size': args.world_size,
'local_rank': max(0, args.local_rank),
'allreduce_post_accumulation': args.allreduce_post_accumulation,
'deepspeed_zero_optimization': {'stage': args.deepspeed_zero_stage}},
'enable_adasum': False,
'deepspeed_zero_optimization': {'stage': args.deepspeed_zero_stage},
'enable_adasum': False},
'lr_scheduler': lr_scheduler
})