Profiles2020-2025
Cyril Zhang
Microsoft Research NYC
12Papers
9Last author
24Unique co-authors
0First author
0Solo
First and last author come from byline position, which some venues assign alphabetically.
Recent papers12
- Self-Improvement in Language Models: The Sharpening MechanismAuthor 4 of 6ICLR 2025
- Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and AutoregressionAuthor 5 of 6ICLR 2024 · 12 citations
- ASL STEM Wiki: Dataset and Benchmark for Interpreting STEM ArticlesAuthor 6 of 8EMNLP 2024 · 5 citations
- Exposing Attention Glitches with Flip-Flop Language ModelingAuthor 5 of 5NeurIPS 2023 · 90 citations
- Transformers Learn Shortcuts to AutomataAuthor 5 of 5ICLR 2023 · 11 citations
- Pareto Frontiers in Deep Feature Learning: Data, Compute, Width, and LuckAuthor 5 of 5NeurIPS 2023 · 8 citations
- Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational LimitAuthor 6 of 6NeurIPS 2022 · 220 citations
- Inductive Biases and Variable Creation in Self-Attention MechanismsAuthor 4 of 4ICML 2022 · 154 citations
- Sparsity in Partially Controllable Linear SystemsAuthor 4 of 4ICML 2022 · 13 citations
- Recurrent Convolutional Neural Networks Learn Succinct Learning AlgorithmsAuthor 4 of 4NeurIPS 2022 · 2 citations
- Acceleration via Fractal Learning Rate SchedulesAuthor 3 of 3ICML 2021 · 19 citations
- Stochastic Optimization with Laggard Data PipelinesAuthor 5 of 5NeurIPS 2020 · 14 citations
