SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration.

Wed, 01 Jan 2025 00:00:00 +0100

Jintao Zhang, Jia Wei, Pengle Zhang, Jun Zhu, Jianfei Chen:
SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration. ICLR 2025