LSTM

Long Short Term Memory networks – usually just called LSTMs

– are a special kind of RNN

This slideshow requires JavaScript.

Excerpt from colah’s blog