EpochLex entry
Transformer
trans-FOR-mer
A neural-network architecture built around attention mechanisms that can process relationships among pieces of a sequence in parallel and underlies many modern language and multimodal models.
EpochLex entry
trans-FOR-mer
A neural-network architecture built around attention mechanisms that can process relationships among pieces of a sequence in parallel and underlies many modern language and multimodal models.