Kwangjun Ahn, Zhiyu Zhang, Yunbum Kook, Yan Dai: Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise. ICML 2024: 619-640