cross-attention noun1 •A form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ.The cross attention layer inside each transformer decoder block is in fact a multi-head cross attention layer […] — 2024
