Notes on: Ollivier, Y. (2013): Riemannian metrics for neural networks i: feedforward networks

Table of Contents

Overview

  • Backprogagtion is slow and is not invariant
  • Introduce four methods which are invariant
  • Develop a suitable framework for building invariant algorithms, by treating NNs in the context of Riemannian geometry