onnxruntime/orttraining/tools/ci_test/results/ci-mi100.huggingface.bart-large.json
Suffian Khan 00b0a9c127
Add hugging-face models loss curve and performance guards to ROCm CI pipeline. (#8915)
* test running hf bert-large

* try again

* try again

* include other models

* correct names

* disable deberta-v2-xxlarge

* avoid torch.distributed

* add compare json loss and perf for bert-large to test

* fix sed expression

* remove pytest

* add more models

* move unit tests u

* display samples/sec
2021-09-01 09:03:10 -07:00

57 lines
No EOL
1,002 B
JSON

{
"steps": [
{
"step": 20,
"loss": 5.9949
},
{
"step": 40,
"loss": 3.7808
},
{
"step": 60,
"loss": 3.4385
},
{
"step": 80,
"loss": 3.3679
},
{
"step": 100,
"loss": 3.2163
},
{
"step": 120,
"loss": 3.1817
},
{
"step": 140,
"loss": 3.1556
},
{
"step": 160,
"loss": 3.0778
},
{
"step": 180,
"loss": 3.0072
},
{
"step": 200,
"loss": 3.0134
},
{
"step": 220,
"loss": 2.9648
},
{
"step": 240,
"loss": 2.9377
},
{
"step": 260,
"loss": 2.9206
}
],
"samples_per_second": 20.253
}