eellison 39fc280dce Dont precompile already seen keys, limit epilogue choices (#122642) ...

Two changes:
- in epilogue benchmark fusion, only take top 6 choices. There were basically no choices taken after this in HF.
- Share a single precompilation function among matmuls with same key.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/122642
Approved by: https://github.com/shunting314
ghstack dependencies: #124030

2024-04-19 17:34:22 +00:00

0 lines

Python

Raw Blame History