EpochLex entry

Context Rot

KON-text rot

The tendency for a language model's ability to use relevant information reliably to decline as the amount of context grows, even when the needed information remains inside the context window.