The transformer architecture consists of an encoder and a decoder. The encoder processes the input sequence, ... The versatility of transformer networks extends beyond NLP.