← Home

Keys, Queries & Values

How transformers decide which words matter to each other. Click a token to see its attention pattern.

"The cat is eating" → [The, cat, is, eat, ing]
Full Attention Map