Introduction to Adam Optimizer & advancements leading to it

This is a presentation I gave at one of the Journal Club meetings in the computational imaging group at Harvard (Wadduwage Lab).

It covers how full-batch gradient descent [1] evolved into the Adam optimizer [2] as researchers addressed practical optimization challenges.

You can download the slides below. 👇