Understanding backward passes (kratzert.github.io)
Understanding the backward pass through a Batch Normalization Layer
Contents:
- Batch normalization (BN): a definition
- Backprop: a definition
- Computational graph of a BN layer
- The power of the chain rule
- Finally: the Backpass of the BN (steps 9-0)
- Naive implementation
- Batch normalization (BN): a definition
- Backprop: a definition
- Computational graph of a BN layer
- The power of the chain rule
- Finally: the Backpass of the BN (steps 9-0)
- Naive implementation