As of 2026-11-04
Vision Transformer applies a Transformer encoder to sequences of image patches. The paper shows that attention-based image models can compete strongly when pretrained at sufficient scale.
Revision snapshot
Overview. Vision Transformer applies a Transformer encoder to sequences of image patches.
Context. The paper shows that attention-based image models can compete strongly when pretrained at sufficient scale.