saymrwulf/transformers
1
0
Fork 0
mirror of https://github.com/saymrwulf/transformers.git synced 2026-05-14 20:58:08 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix: fix gradient accumulate step for learning rate (#27667)

Browse source
This commit is contained in:
Phuc Van Phan 2023-12-07 13:59:26 +07:00 committed by GitHub
parent f84d85ba67
commit 0410a29a2d
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
examples/flax/speech-recognition/run_flax_speech_recognition_seq2seq.py
View file

@ -640,7 +640,7 @@ def main():
# Create learning rate schedule
linear_decay_lr_schedule_fn = create_learning_rate_fn(
len(vectorized_datasets["train"]),
total_train_steps,
training_args.warmup_steps,
training_args.learning_rate,
)