Josh Merel: Feb 18th

ADADELTA and LSTMs

We will discuss the adadelta paper
http://arxiv.org/pdf/1212.5701v1.pdf

and talk about LSTM layers. The original paper is (for reference): http://deeplearning.cs.cmu.edu/pdfs/Hochreiter97_lstm.pdf
But we will probably discuss a more recent result using LSTM layers that uses a slightly different notation.