Notes on: Choromanska, A., Henaff, M., Mathieu, M., Arous, G\'erard Ben, & LeCun, Y. (2014): The loss surfaces of multilayer networks

Table of Contents

Overview

Notation

Spin-glass model

https://www.wikiwand.com/en/Spin_glass

  • Disorded magnet, in a sense that the magnetic spins are not aligned in a regular pattern
    • Contrast to the Ising model, in which case spins are up or down, in the spin-glass model the spins can be in any direction