COMP9444 Neural Networks and Deep Learning
Quiz 5 (Recurrent Networks)
This is an optional quiz to test your understanding of
Recurrent Networks from Week 5.
- Explain the format and method by which input was
fed to the NetTalk system, and the target output.
- Explain the role of the context layer in an Elman network.
- Draw a diagram of an LSTM and write the equations
for its operation.
- Draw a diagram of a Gated Recurrent Unit and write the equitions
for its operation.
- Briefly describe the problem of long range dependencies,
and discuss how well each of the following architectures is able
to deal with long range dependencies:
- sliding window approach
- Simple Recurrent (Elman) Network
- Long Short Term Memory (LSTM)
- Gated Recurrent Unit (GRU)