Profiles2020-2024
Frederik Kunstner
4Papers
0Last author
5Unique co-authors
2First author
0Solo
First and last author come from byline position, which some venues assign alphabetically.
Recent papers4
- Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language ModelsAuthor 2 of 3NeurIPS 2024 · 100 citations
- Searching for Optimal Per-Coordinate Step-sizes with Multidimensional BacktrackingAuthor 1 of 4NeurIPS 2023 · 14 citations
- Noise Is Not the Main Factor Behind the Gap Between Sgd and Adam on Transformers, But Sign Descent Might BeAuthor 1 of 4ICLR 2023 · 5 citations
- BackPACK: Packing more into BackpropAuthor 2 of 3ICLR 2020 · 114 citations
