SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization.

Wed, 01 Jan 2025 00:00:00 +0100

Jintao Zhang, Haofeng Huang, Pengle Zhang, Jia Wei, Jun Zhu, Jianfei Chen:
SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization. ICML 2025