4. Recurrent vs normal feed forward
Normal feed forward meant for basic tasks
such as classification
No memory component
Recurrent can be used to learn sequences
Different backpropagation
5. BPTT vs normal Backprop
Extra weight matrices represent a sort of
“memory component”
Learns to minimize sequences rather than just
one classification
12. All about predicting the future
Recurrent net sequence learning allows for us
to predict anything with a time axis
Think about videos and forecasting movement
over time