Lost in the Middle — AI Glossary

Reference details

Related terms

• Context Stuffing
• Long-Context Model
• Positional Bias

Example: Position changes the answer

Place the answer-bearing passage first among twenty and the model finds it reliably. Move the same passage to position ten and accuracy drops measurably, with no change to the passage or the question. Retrieval accuracy follows a U across position — strong at both ends, weakest in the middle.

Commonly confused with

This is not a context-length limit. The model accepts the tokens and processes them; it attends to the middle less effectively. A page that fits comfortably inside the window can still be read poorly, which is why fitting is not the same as using.

When to use it

Reach for it when:

• Ordering retrieved chunks — put the strongest first or last
• Explaining why long-context recall tests disappoint in practice
• Deciding between fewer, better passages and more, worse ones

Reach for something else when:

• As an argument against long context generally — the effect varies by model
• Assuming it is fixed; newer models differ and it is worth re-testing

Primary source

• Liu et al., Lost in the Middle: How Language Models Use Long Contexts (arXiv)

Continue your research

Use these connected ModelRefs sections to compare alternatives, inspect implementation paths, and review the evidence and governance boundaries relevant to Lost in the Middle — AI Glossary.

• Browse models
• Review providers
• Inspect benchmarks
• Explore workflows
• Learn AI concepts
• Read decision guides
• Review trust and methodology
• Start a decision path