Since most material has been covered in previous blogs, I will go through this lecture contents in brief.
For classification we have:
- Softmax output layer
- Cross-entropy Loss function
For regression we have:
- Linear output layer
- Mean square error lLoss function
- LeCun, Yann, Yoshua Bengio, and Geoffrey Hinton. “Deep learning.” nature 521.7553 (2015):
- A Comprehensive Guide to Convolutional Neural Networks.