EpochLex entry
Self-Attention
self uh-TEN-shun
An attention mechanism in which elements within the same input sequence compare with one another so the model can represent how those elements relate in context.
EpochLex entry
self uh-TEN-shun
An attention mechanism in which elements within the same input sequence compare with one another so the model can represent how those elements relate in context.