saymrwulf/transformers
1
0
Fork 0
mirror of https://github.com/saymrwulf/transformers.git synced 2026-05-14 20:58:08 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

update

Browse source
This commit is contained in:
MekkCyber 2025-02-10 07:06:53 +00:00
parent 1a5bfc1de5
commit 820ae396a4
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
src/transformers/integrations/fp8.py
View file

@ -227,7 +227,7 @@ def w8a8_block_fp8_matmul_triton(
return C
# Python version of the above triton function
# Python version of the above triton function, it's much slower than the triton version
@torch.compile
def w8a8_block_fp8_matmul_compile(
input_q: torch.Tensor, # [batch, seq_len, hidden_dim]