Lune

Profiles2020-2025

Cyril Zhang

Microsoft Research NYC

12Papers
9Last author
24Unique co-authors
0First author
0Solo

First and last author come from byline position, which some venues assign alphabetically.

Recent papers12

  1. Self-Improvement in Language Models: The Sharpening MechanismAuthor 4 of 6ICLR 2025
  2. Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and AutoregressionAuthor 5 of 6ICLR 2024 · 12 citations
  3. ASL STEM Wiki: Dataset and Benchmark for Interpreting STEM ArticlesAuthor 6 of 8EMNLP 2024 · 5 citations
  4. Exposing Attention Glitches with Flip-Flop Language ModelingAuthor 5 of 5NeurIPS 2023 · 90 citations
  5. Transformers Learn Shortcuts to AutomataAuthor 5 of 5ICLR 2023 · 11 citations
  6. Pareto Frontiers in Deep Feature Learning: Data, Compute, Width, and LuckAuthor 5 of 5NeurIPS 2023 · 8 citations
  7. Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational LimitAuthor 6 of 6NeurIPS 2022 · 220 citations
  8. Inductive Biases and Variable Creation in Self-Attention MechanismsAuthor 4 of 4ICML 2022 · 154 citations
  9. Sparsity in Partially Controllable Linear SystemsAuthor 4 of 4ICML 2022 · 13 citations
  10. Recurrent Convolutional Neural Networks Learn Succinct Learning AlgorithmsAuthor 4 of 4NeurIPS 2022 · 2 citations
  11. Acceleration via Fractal Learning Rate SchedulesAuthor 3 of 3ICML 2021 · 19 citations
  12. Stochastic Optimization with Laggard Data PipelinesAuthor 5 of 5NeurIPS 2020 · 14 citations
Dusk over the sea between two cliffs drawn in fine vertical lines