Self-attention
Self-attention computes content-dependent interactions among positions in the same sequence. Queries and keys determine weights while values carry the information combined at each position.
Overview. Self-attention computes content-dependent interactions among positions in the same sequence.
Context. Queries and keys determine weights while values carry the information combined at each position.
Claims and evidence
Claim ledger, 2Self-attention computes content-dependent interactions among positions in the same sequence.
Queries and keys determine weights while values carry the information combined at each position.