Tensors
Tensors generalize scalars, vectors, and matrices to arrays with more axes. Axis meaning—batch, token, head, channel, or feature—is part of the computation and must be tracked explicitly.
X\in\mathbb{R}^{B\times T\times D}
Overview. Tensors generalize scalars, vectors, and matrices to arrays with more axes.
Context. Axis meaning—batch, token, head, channel, or feature—is part of the computation and must be tracked explicitly.
Claims and evidence
Claim ledger, 2Tensors generalize scalars, vectors, and matrices to arrays with more axes.
Axis meaning—batch, token, head, channel, or feature—is part of the computation and must be tracked explicitly.