onnxruntime/orttraining/tools/ci_test/results/ci-mi100.huggingface.roberta-large.json
Suffian Khan 00b0a9c127
Add hugging-face models loss curve and performance guards to ROCm CI pipeline. (#8915)
* test running hf bert-large

* try again

* try again

* include other models

* correct names

* disable deberta-v2-xxlarge

* avoid torch.distributed

* add compare json loss and perf for bert-large to test

* fix sed expression

* remove pytest

* add more models

* move unit tests u

* display samples/sec
2021-09-01 09:03:10 -07:00

57 lines
No EOL
998 B
JSON

{
"steps": [
{
"step": 20,
"loss": 4.8197
},
{
"step": 40,
"loss": 3.8907
},
{
"step": 60,
"loss": 3.3169
},
{
"step": 80,
"loss": 1.9865
},
{
"step": 100,
"loss": 1.784
},
{
"step": 120,
"loss": 1.4789
},
{
"step": 140,
"loss": 1.3819
},
{
"step": 160,
"loss": 1.3282
},
{
"step": 180,
"loss": 1.453
},
{
"step": 200,
"loss": 1.2205
},
{
"step": 220,
"loss": 1.2752
},
{
"step": 240,
"loss": 1.172
},
{
"step": 260,
"loss": 1.263
}
],
"samples_per_second": 37.399
}