saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-05-14 20:48:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/csharp/test
History
Xavier Dupré e726151b5c
Introduce float 8 types (#14731) 
### Description
The PR implements FloatE4M3FN, FloatE5M2, FloatE4MEFNUZ, FloatE5M2FNUZ
as described in PR https://github.com/onnx/onnx/pull/4805. It uses CUDA
API to cast float/half to float8 if CUDA>=11.8, a custom implementation
if CUDA<11.8.

* It implements, Cast, QuantizeLinear, DequantizeLinear for all types on
CPU, only for types FloatE4M3FN, FloatE5M2 on CUDA.
* It extends the supported types for control flow operator, Shape,
Reshape, Identity, If, Loop, Scan, Reshape
* It implements Equal(19).
* Cast, QuantizeLinear, DequantizeLinear operators now support a
parameter `saturate` only valid for float 8 types. It is true by
default. In that case, any value out of range is converted into the
maximum float 8 value. If false, it is infinite.
* QuantizeLinear, DequantizeLinear now supports multiple scales on CUDA
(and ROCm by extension), scale = 1D tensor with one scale per channel

### Motivation and Context
Supports latest onnx version.

Fixes
[AB#15395](https://aiinfra.visualstudio.com/6a833879-cd9b-44a4-a9de-adc2d818f13c/_workitems/edit/15395)

---------

Co-authored-by: Xavier Dupre <xadupre@microsoft.com@orttrainingdev8.d32nl1ml4oruzj4qz3bqlggovf.px.internal.cloudapp.net>
Co-authored-by: Randy Shuai <rashuai@microsoft.com>
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
Co-authored-by: Scott McKay <Scott.McKay@microsoft.com>
2023-05-30 13:25:58 -07:00
..
Microsoft.AI.MachineLearning.Tests Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
Microsoft.AI.MachineLearning.Tests.DotNet5_0
Microsoft.AI.MachineLearning.Tests.Uwp Fix Microsoft.AI.MachineLearning NuGet App failure with multiple binaries copied to same destination (#10076) 2021-12-21 12:34:03 -08:00
Microsoft.ML.OnnxRuntime.EndToEndTests [C#] Add missing rocm csharp api (#15540) 2023-05-18 08:15:19 +08:00
Microsoft.ML.OnnxRuntime.EndToEndTests.Mobile Bump Newtonsoft.Json from 13.0.1 to 13.0.2 in /csharp/test/Microsoft.ML.OnnxRuntime.EndToEndTests.Mobile/EndToEndTests.Mobile.Automation (#13884) 2022-12-09 13:07:05 -08:00
Microsoft.ML.OnnxRuntime.Tests.Common [C#] Add missing rocm csharp api (#15540) 2023-05-18 08:15:19 +08:00
Microsoft.ML.OnnxRuntime.Tests.Devices Add Xamarin support (#9436) 2021-10-27 20:07:07 +10:00
Microsoft.ML.OnnxRuntime.Tests.Droid Various fixes to the CSharp setup (#15782) 2023-05-05 14:27:30 +10:00
Microsoft.ML.OnnxRuntime.Tests.iOS Add .net6 support to the C# nuget package. (#11908) 2022-06-22 08:08:24 +10:00
Microsoft.ML.OnnxRuntime.Tests.NetCoreApp Introduce float 8 types (#14731) 2023-05-30 13:25:58 -07:00