Vincent Wang 9f68a27c7a [ORTModule] Handle Cast on Constant Number on Triton Code-gen (#19321) ... When using scaled_dot_product_attention on float16 type, the exported graph has Sqrt(float16(constant)), which cannot be ConstantFold in ORT because Sqrt CPU kernel doesn't support float16. This causes Triton code-gen generates code like: result = 128.0.to(tl.float32) This code cannot be compiled because .to() cannot be applied to constant. This PR is to handle such case that constant number will not do the Cast.		2024-01-30 17:04:01 +08:00
..
amp	[Better Engineering] Bump ruff to 0.0.278 and fix new lint errors (#16789)	2023-07-21 12:53:41 -07:00
api	[On-Device Training] Expose Parameters through the Training API (#17364)	2023-09-25 20:03:24 -07:00
experimental	Manage ORTModule configurations consistently (#16396)	2023-06-27 19:19:36 +08:00
onnxblock	Offline tooling for training to use reduction with keepdims=False (#19027)	2024-01-11 10:51:23 -08:00
optim	FP16 optimizer automatically detect DeepSpeed compatibility (#18084)	2023-10-25 15:11:02 +08:00
ort_triton	[ORTModule] Handle Cast on Constant Number on Triton Code-gen (#19321)	2024-01-30 17:04:01 +08:00
ortmodule	ORTModule memory improvement (#18924)	2024-01-16 08:57:37 +08:00
utils	ORTModule memory improvement (#18924)	2024-01-16 08:57:37 +08:00
__init__.py	Removed all the deprecated python training code and related tests and utils (#18333)	2023-11-17 18:19:21 -08:00
_utils.py	Removed all the deprecated python training code and related tests and utils (#18333)	2023-11-17 18:19:21 -08:00
artifacts.py	Fix opset version of the optimizer in function generate_artifacts (#18300)	2023-11-22 09:15:11 -08:00