The original transformer was designed as a sequence-to-sequence (seq2seq) model for machine translation (of course, seq2seq models are not limited to translation tasks).

For example, the sentence 'Write a story.' is divided into 'Write' 'a' 'story' '.' '. (4)'. Transformer block When the token embedding and position encoding are completed, the process of ...