The encoder of transformer has a lot of repeated operations during decoding

[kev1876]

The following code is the decoding process of transformer.Each prediction requires repeated calculation of the encoding output.Is there a better way to design