SageAttention3: Microscaling FP4 Attention for Inference and An Exploration of 8-Bit Training.

Thu, 01 May 2025 01:00:00 +0200

Jintao Zhang, Jia Wei, Pengle Zhang, Xiaoming Xu, Haofeng Huang, Haoxu Wang, Kai Jiang, Jun Zhu, Jianfei Chen:
SageAttention3: Microscaling FP4 Attention for Inference and An Exploration of 8-Bit Training. CoRR abs/2505.11594 (2025)