Query–Key Retrieval

Attention is lookup. The query at the question reaches back across the entire document and lights up the one key that answers it — every other token barely registers.

// earlier in the document
QUERY · THE QUESTION
Whatisthe capitalofFrance?
Attention weights · query("capital of France")
Retrieved
query("capital of France")
key("Paris")
value pulled out · weight 0.58