onnxruntime/orttraining/orttraining/python/training/ortmodule
Vincent Wang 1bfc26685b
ATen Op Supports Int Return Type and CPU Tensor Arguments (#19773)
This PR:
- add support for int as return type, will create a CPU scalar tensor
for it.
- add attributes to specify which arguments or returns are CPU tensors.
- adjust ATen efficient attn to match latest PyTorch native function.
- a Triton codegen bugfix by the way.
2024-03-06 10:11:46 +08:00
..
experimental Bump ruff linter to 0.2.1 (#19471) 2024-02-08 16:08:27 -08:00
graph_optimizers ATen Op Supports Int Return Type and CPU Tensor Arguments (#19773) 2024-03-06 10:11:46 +08:00
torch_cpp_extensions Update the default std flag used during torch extensions compilation (#19516) 2024-02-14 12:49:34 -08:00
__init__.py Upgrade default ORTModule opset from 15 to 17 (#19315) 2024-02-14 11:19:33 -08:00
_custom_autograd_function.py Improve perf for stage3 training (#18099) 2023-12-15 13:32:19 +08:00
_custom_autograd_function_exporter.py Bump ruff linter to 0.2.1 (#19471) 2024-02-08 16:08:27 -08:00
_custom_gradient_registry.py Bump ruff linter to 0.2.1 (#19471) 2024-02-08 16:08:27 -08:00
_custom_op_symbolic_registry.py Upgrade default ORTModule opset from 15 to 17 (#19315) 2024-02-14 11:19:33 -08:00
_execution_agent.py Memory optimization refactor and refinement (#17481) 2023-11-23 11:39:00 +08:00
_fallback.py Bump linter versions (#18341) 2023-11-08 13:04:40 -08:00
_fallback_exceptions.py
_gradient_accumulation_manager.py
_graph_execution_interface.py
_graph_execution_manager.py Fix seed for recomputed Dropout (#19715) 2024-03-06 10:06:25 +08:00
_graph_execution_manager_factory.py ORTModule log clean up (#16795) 2023-07-26 12:42:50 +08:00
_inference_manager.py Tune ORTModule logging experience a bit (#18298) 2023-11-08 17:42:50 +08:00
_io.py Skip module clone for preparing large model export (#18663) 2023-12-05 12:41:17 -08:00
_logger.py Memory optimization refactor and refinement (#17481) 2023-11-23 11:39:00 +08:00
_mem_efficient_grad_mgmt.py ORTModule memory improvement (#18924) 2024-01-16 08:57:37 +08:00
_onnx_models.py ORTModule memory improvement (#18924) 2024-01-16 08:57:37 +08:00
_pythonop_helper.py ORTModule memory improvement (#18924) 2024-01-16 08:57:37 +08:00
_runtime_inspector.py Fix seed for recomputed Dropout (#19715) 2024-03-06 10:06:25 +08:00
_torch_module_factory.py Manage ORTModule configurations consistently (#16396) 2023-06-27 19:19:36 +08:00
_torch_module_interface.py
_torch_module_ort.py ORTModule log clean up (#16795) 2023-07-26 12:42:50 +08:00
_torch_module_pytorch.py
_training_manager.py Zhijxu/cleanup cached tensors when oom (#19306) 2024-02-21 10:41:42 +08:00
_utils.py Use full qualified name for PythonOp export (#17021) 2023-08-09 10:58:33 +08:00
_zero_stage3_compatibility.py Improve perf for stage3 training (#18099) 2023-12-15 13:32:19 +08:00
graph_optimizer_registry.py [ORTModule] ATen Efficient Attention and Triton Flash Attention (#17959) 2023-10-27 10:29:27 +08:00
options.py Fix seed for recomputed Dropout (#19715) 2024-03-06 10:06:25 +08:00
ortmodule.py ORTModule log clean up (#16795) 2023-07-26 12:42:50 +08:00