LongAttn: Selecting Long-context Training Data via Token-level Attention.

Sat, 01 Feb 2025 00:00:00 +0100

Longyun Wu, Dawei Zhu, Guangxiang Zhao, Zhuocheng Yu, Junfeng Ran, Xiangyu Wong, Lin Sun , Sujian Li:
LongAttn: Selecting Long-context Training Data via Token-level Attention. CoRR abs/2502.16860 (2025)