[Neural Networks and Deep Learning] 3주차

Neural Network Representation

 

Computing a Neural Network's Output

 

Vectorizing across multiple examples

 

Justification for vectorized implementation

 

Activation functions

 

Why do you need Non-Linear Activation Functions?

 

Derivatives of Activation Functions

 

Gradient descent for neural networks

 

Formulas for computing derivatives

 

What happens if you initialize weights to zero?

 

Random initialization