onnxruntime/samples/python/training/orttrainer/pytorch_transformer
Justin Chu fdce4fa6af
Format all python files under onnxruntime with black and isort (#11324)
Description: Format all python files under onnxruntime with black and isort.

After checking in, we can use .git-blame-ignore-revs to ignore the formatting PR in git blame.

#11315, #11316
2022-04-26 09:35:16 -07:00
..
ort_train.py Format all python files under onnxruntime with black and isort (#11324) 2022-04-26 09:35:16 -07:00
ort_utils.py Format all python files under onnxruntime with black and isort (#11324) 2022-04-26 09:35:16 -07:00
pt_model.py Format all python files under onnxruntime with black and isort (#11324) 2022-04-26 09:35:16 -07:00
pt_train.py Format all python files under onnxruntime with black and isort (#11324) 2022-04-26 09:35:16 -07:00
README.md Update ORTModule frontend code owner file (#8335) 2021-07-14 09:26:04 -07:00
utils.py Format all python files under onnxruntime with black and isort (#11324) 2022-04-26 09:35:16 -07:00

TransformerModel example

This example was adapted from Pytorch's Sequence-to-Sequence Modeling with nn.Transformer and TorchText tutorial

Requirements

  • PyTorch 1.6+
  • TorchText 0.6+
  • ONNX Runtime 1.5+

Running PyTorch version

python pt_train.py

Running ONNX Runtime version

python ort_train.py

Optional arguments

Argument Description Default
--batch-size input batch size for training 20
--test-batch-size input batch size for testing 20
--epochs number of epochs to train 2
--lr learning rate 0.001
--no-cuda disables CUDA training False
--seed random seed 1
--log-interval how many batches to wait before logging training status 200