EpochLex entry

Cross-Attention

KROSS uh-TEN-shun

An attention mechanism in which one sequence or representation supplies the queries while a different sequence or representation supplies the keys and values, allowing information from one source to guide processing of another.