An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

by Google Brain · free · Last verified 2026-03-17

Introduced the Vision Transformer (ViT), demonstrating that a pure transformer applied directly to sequences of image patches achieves state-of-the-art performance on image classification when pretrained on large datasets. The paper challenged the dominance of convolutional neural networks in computer vision.