Long Short-Term Memory Networks (LSTMs)

In this nice post,  LSTMs are described to have more control than typical RNNs over what they remember. In general, this allows them to learn much more complex patterns. Weaknesses and strenghts are discussed.