The transformer’s encoder doesn’t just send a final step of encoding to the decoder; it transmits all hidden states and encodings. This rich information allows the decoder to apply attention ...