The original transformer was designed as a sequence-to-sequence (seq2seq) model for machine translation (of course, seq2seq models are not limited to translation tasks).

The large-scale language model, which is the basis of chat AI that enables natural conversation such as ChatGPT, uses the machine learning architecture `` Transformer '' developed by ...