Cross-attention

noun

noun ·Rare ·Advanced level

Definitions

Noun
  1. 1
    A form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ. uncountable

    "The cross attention layer inside each transformer decoder block is in fact a multi-head cross attention layer […]"

Example

More examples

"The cross attention layer inside each transformer decoder block is in fact a multi-head cross attention layer […]"

Etymology

From cross- + attention.

More for "cross-attention"

SynonymsSentencesPronunciationTranslate

Next best steps

Find stronger synonymsSee usage examplesCheck pronunciationBrowse writing guides

Data sourced from Wiktionary, WordNet, CMU, and other open linguistic databases. Updated March 2026.