A Controlled Study on Long Context Extension and Generalization in LLMs.

Mon, 01 Jan 2024 00:00:00 +0100

Yi Lu, Jing Nathan Yan, Songlin Yang, Justin T. Chiu, Siyu Ren, Fei Yuan, Wenting Zhao, Zhiyong Wu, Alexander M. Rush:
A Controlled Study on Long Context Extension and Generalization in LLMs. CoRR abs/2409.12181 (2024)