Since most material has been covered in previous blogs, I will go through this lecture contents in brief.

Brief overview

More Contents

Activation function example

Task example

For classification we have:

  1. Softmax output layer
  2. Cross-entropy Loss function

For regression we have:

  1. Linear output layer
  2. Mean square error lLoss function

Supplement reading

  1. LeCun, Yann, Yoshua Bengio, and Geoffrey Hinton. “Deep learning.” nature 521.7553 (2015):
  2. A Comprehensive Guide to Convolutional Neural Networks.

Origin: Dr. Chris Lu (Homepage)
Translate + Edit: YangSier (Homepage)

:cherry_blossom:唠嗑QQ群兔叽的魔术工房 (942848525)