Rakuten interview question

What is a transformer model

Interview Answer

Anonymous

27 May 2025

Instead of processing words sequentially like RNNs or LSTMs, transformers look at all words in a sentence at once using a mechanism called self-attention.