Lune

Profiles2021-2025

Song Mei

UC Berkeley

19Papers
8Last author
19Unique co-authors
1First author
1Solo

First and last author come from byline position, which some venues assign alphabetically.

Recent papers19

  1. Generalization or Hallucination? Understanding Out-of-Context Reasoning in TransformersAuthor 9 of 9NeurIPS 2025 · 10 citations
  2. A Statistical Theory of Contrastive Learning via Approximate Sufficient StatisticsAuthor 3 of 3NeurIPS 2025 · 4 citations
  3. U-Nets as Belief Propagation: Efficient Classification, Denoising, and Diffusion in Generative Hierarchical ModelsAuthor 1 of 1ICLR 2025
  4. How Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with RepresentationsAuthor 3 of 7ICLR 2024 · 80 citations
  5. Transformers as Decision Makers: Provable In-Context Reinforcement Learning via Supervised PretrainingAuthor 3 of 3ICLR 2024 · 74 citations
  6. Large Stepsize Gradient Descent for Non-Homogeneous Two-Layer Networks: Margin Improvement and Fast OptimizationAuthor 3 of 5NeurIPS 2024 · 20 citations
  7. Statistical Estimation in the Spiked Tensor Model via the Quantum Approximate Optimization AlgorithmAuthor 3 of 3NeurIPS 2024 · 7 citations
  8. Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm SelectionAuthor 5 of 5NeurIPS 2023 · 356 citations
  9. What can a Single Attention Layer Learn? A Study Through the Random Features LensAuthor 4 of 4NeurIPS 2023 · 47 citations
  10. Lower Bounds for Learning in Revealing POMDPsAuthor 4 of 5ICML 2023 · 18 citations
  11. Partially Observable RL with B-Stability: Unified Structural Condition and Sharp Sample-Efficient AlgorithmsAuthor 3 of 3ICLR 2023 · 2 citations
  12. When Can We Learn General-Sum Markov Games with a Large Number of Players Sample-Efficiently?Author 2 of 3ICLR 2022 · 83 citations
  13. Near-Optimal Learning of Extensive-Form Games with Imperfect InformationAuthor 3 of 4ICML 2022 · 31 citations
  14. Efficient and Differentiable Conformal Prediction with General Function ClassesAuthor 2 of 5ICLR 2022 · 29 citations
  15. Efficient Phi-Regret Minimization in Extensive-Form Games via Online Mirror DescentAuthor 3 of 5NeurIPS 2022 · 24 citations
  16. Sample-Efficient Learning of Correlated Equilibria in Extensive-Form GamesAuthor 2 of 3NeurIPS 2022 · 11 citations
  17. Don't Just Blame Over-parametrization for Over-confidence: Theoretical Analysis of Calibration in Binary ClassificationAuthor 2 of 4ICML 2021 · 47 citations
  18. Exact Gap between Generalization Error and Uniform Convergence in Random Feature ModelsAuthor 3 of 3ICML 2021 · 19 citations
  19. Understanding the Under-Coverage Bias in Uncertainty EstimationAuthor 2 of 4NeurIPS 2021 · 18 citations
Dusk over the sea between two cliffs drawn in fine vertical lines