Interesting links to Recurrent Neural Networks blog posts and papers:
Step-by-step explanation of LSTM networks
Blog post on applications of RNNs
Attention and other extensions of the basic RNN architecture
Blog post on attention and memory in Deep Learning
Implementation of RNN and LSTM in Python using Numpy and Theano Part 1 - 4
Presentation on Recurrent Neural Networks, the Vanishing Gradient Problem and LSTM/GRU
Python implementation and tutorial on an RNN for sentiment analysis
Python character level language model with mxnet
Generating text with an LSTM in R
Googles Machine Translation using encoder-decoder deep LSTM networks
Effective Approaches to Attention-based Neural Machine Translation