mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-05-14 20:48:00 +00:00
5e8952ef89
Description: This change makes three changes to the ThreadPool class to clean up issues identified during performance analysis and optimization. (1) It uses mm_pause intrinsics in spin loops, helping avoid consuming pipeline resources while waiting. (2) It re-organizes the spin-then-steal loop for work distribution to start out spinning as intended, rather than to start out trying to steal. (3) It updates the ThreadPool class's API to be consistent in the use of static methods for public functions. The PR includes minor doc updates and corresponding changes to test cases. Motivation and Context The change helps ensure consistency in behavior between the OpenMP and Eigen-based implementations. Unlike the instance methods, the static methods abstract over the different ways in which threading can be implemented; they will map onto the OpenMP or Eigen-based implementations when threading is used. When threading is not used they will run work sequentially. |
||
|---|---|---|
| .. | ||
| execution_providers | ||
| images | ||
| python | ||
| ABI_Dev_Notes.md | ||
| AddingCustomOp.md | ||
| AddingExecutionProvider.md | ||
| Android_testing.md | ||
| C_API.md | ||
| cmake_guideline.md | ||
| Coding_Conventions_and_Standards.md | ||
| ContribOperators.md | ||
| CSharp_API.md | ||
| ExportPyTorchCustomOps.md | ||
| FAQ.md | ||
| How_To_Update_ONNX_Dev_Notes.md | ||
| InferenceHighLevelDesign.md | ||
| Java_API.md | ||
| Model_Test.md | ||
| NotesOnThreading.md | ||
| ONNX_Runtime_for_Mobile_Platforms.md | ||
| ONNX_Runtime_Graph_Optimizations.md | ||
| ONNX_Runtime_Perf_Tuning.md | ||
| ONNX_Runtime_Server_Usage.md | ||
| onnxruntime_dependencies.dot | ||
| onnxruntime_dependencies.png | ||
| OperatorKernels.md | ||
| PR_Guidelines.md | ||
| Privacy.md | ||
| PyOp.md | ||
| Python_Dev_Notes.md | ||
| Reduced_Operator_Kernel_build.md | ||
| ReleaseManagement.md | ||
| Roadmap.md | ||
| Server.md | ||
| Versioning.md | ||
| WinRT_API.md | ||
