Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs.

Mon, 01 Jan 2024 00:00:00 +0100

Runchu Tian, Yanghao Li, Yuepeng Fu, Siyang Deng, Qinyu Luo, Cheng Qian, Shuo Wang, Xin Cong, Zhong Zhang , Yesai Wu, Yankai Lin, Huadong Wang, Xiaojiang Liu:
Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs. CoRR abs/2410.14641 (2024)