In encoder-decoder architectures, the outputs in the encoder blocks act because the queries to the intermediate representation on the decoder, which delivers the keys and values to work out a illustration of your decoder conditioned on the encoder. This interest is referred to as cross-interest.This “chain of considered”, characterised through