Accepting long input is different from finding evidence

The experiments include multi-document question answering and key-value retrieval. They distinguish accepting a long input from finding the needed evidence within it. The paper is evidence about specific systems and tasks, not a permanent ranking of newer models.

Move the answer passage in your own test

For an original application test, move the same answer-bearing passage between the beginning, middle, and end. Keep the question unchanged and measure whether the system uses the evidence consistently.

THE TAKEAWAY

What to remember

Check supported answers, not input capacity.

Sources & further reading

  1. Lost in the Middle: How Language Models Use Long Contexts ↗
How this story was made

Written by Kristian Kostov with AI assistance and checked against the linked sources. Company performance claims are attributed to the company. Analysis reflects AiLookout’s interpretation; we have not independently tested the products discussed. Cover photography is illustrative and does not depict the specific announcement or product.

Our editorial standards
Back to all stories