“Adam: A Method for Stochastic Optimization” – is one of the most highly cited papers ever published. Moreover, this paper was written in 2014 by two PhD students! Let’s see why it became so popular and if we can learn anything from it.

A relevant video by @SimonClark    • I read the top 100 scientific papers ...  

00:00 Incredible number of citations
02:37 Authors of the “Adam” paper
04:40 What is Adam method?
05:26 Let’s check the paper!
10:10 Can we learn from it?
10:38 YES
12:26 NO
13:52 Other highly cited papers
14:49 “Adam” is an unusual paper
16:02 Attitude to research
17:15 Other features

Andrey Churkin (Андрей Чуркин) 2024
https://andreychurkin.ru/