paperPrimary sourceVerified

Attention Is All You Need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin · 2017

Google Brain / Google Research

The Transformer paper. Introduces self-attention and multi-head attention, replacing recurrence and convolutions for sequence modeling. The architectural basis for all modern LLMs.

Metadata

Type: paper
Credibility: Primary source
Language: en
Publication date: June 12, 2017
Organization: Google Brain / Google Research
Authors: Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
URL: https://arxiv.org/abs/1706.03762
Last verified: April 12, 2026

Cited in 0 articles

Not cited in any article yet.