Asked about Sequence models before transformers
What did LSTM add?
An answer that works
Gates that let information pass through the cell state largely unchanged, which helped gradients survive across many steps. It addressed long-range dependencies and did nothing about the lack of parallelism.
Reading an answer is not being able to give one. The section that teaches this is Sequence models before transformers, 5 hours of Sequence models before transformers.
Learn this properlyAlso asked about Sequence models before transformers