Can you link a resource that is able to adequately explain why they're called Ke... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		thrtythreeforty on Jan 4, 2024 \| parent \| context \| favorite \| on: Understand how transformers work by demystifying t... Can you link a resource that is able to adequately explain why they're called Key, Query, and Value? Every explanation I've read eventually handwaved this. It feels like understanding why they're named that is key (heh) to understanding the concept, rather than just blindly implementing matmul.

pests on Jan 4, 2024 [–]

https://stats.stackexchange.com/questions/421935/what-exactl...

It mentions it comes from the original Attention Is All You Need paper and goes on into more detail.

It seems to be named exactly as you would expect. Key/Value as in KV store, with Query being the term being retrived.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact