saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-28 20:11:22 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Fix ValueError when testing PyTorch performance (#14450)

Browse source 
### Description
Fixed an exception that is thrown inside `transformers` when trying to
test PyTorch performance:
```
> python convert_generation.py -m gpt2 --output gpt2_greedy_search.onnx --num_beams 1 --num_return_sequences 1 --torch_performance
This commit is contained in:
Ivan Komarov 2023-02-25 08:39:14 +03:00 committed by GitHub
parent 6603be26c6
commit 9f6d452ca6
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
onnxruntime/python/tools/transformers/convert_generation.py
View file

@ -1850,7 +1850,7 @@ def test_torch_performance(
num_return_sequences=args.num_return_sequences,
length_penalty=args.length_penalty,
repetition_penalty=args.repetition_penalty,
bad_words_ids=bad_words_ids,
bad_words_ids=bad_words_ids if bad_words_ids else None,
return_dict_in_generate=True,
output_scores=args.output_sequences_scores or args.output_token_scores,
)