Lost-in-the-middle
Lost-in-the-middle (LITM) problems refer to the category of problems that LLMs face when trying to utilise long context windows.
One particular effect that longer context window LLMs suffer from is accuracy degradation when relevant information is placed towards the middle of the input context.