LongAttn: Selecting Long-context Training Data via Token-level Attention.

Wed, 01 Jan 2025 00:00:00 +0100

Longyun Wu, Dawei Zhu, Guangxiang Zhao, Zhuocheng Yu, Junfeng Ran, Xiangyu Wong, Lin Sun, Sujian Li:
LongAttn: Selecting Long-context Training Data via Token-level Attention. ACL (Findings) 2025: 19367-19380