What is a ‘recurrent neural network’ (RNN) and what limitation led to its replacement by transformers?

Question

AI Fundamentals — Medium

What is a ‘recurrent neural network’ (RNN) and what limitation led to its replacement by transformers?

Accepted Answer

A recurrent neural network (RNN) processes sequential data by maintaining hidden state across steps. However, it is limited by vanishing gradients and inability to parallelize training, leading to its replacement by transformers.