How transformers work Standard transformer architecture consists of three main components - the encoder, the decoder and the attention mechanism.