InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory.

Mon, 01 Jan 2024 00:00:00 +0100

Chaojun Xiao, Pengle Zhang, Xu Han, Guangxuan Xiao, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Maosong Sun:
InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory. NeurIPS 2024