“Adam: A Method for Stochastic Optimization” – is one of the most highly cited papers ever published. Moreover, this paper was written in 2014 by two PhD students! Let’s see why it became so popular and if we can learn anything from it. A relevant video by @SimonClark https://www.youtube.com/watch?v=4sLWRScmfH0 00:00 Incredible number of citations 02:37 Authors of the “Adam” paper 04:40 What is Adam method? 05:26 Let’s check the paper! 10:10 Can we learn from it? 10:38 YES 12:26 NO 13:52 Other highly cited papers 14:49 “Adam” is an unusual paper 16:02 Attitude to research 17:15 Other features Andrey Churkin (Андрей Чуркин) 2024 https://andreychurkin.ru/