Profiles2020-2022
Di He
Microsoft Research
8Papers
0Last author
16Unique co-authors
0First author
0Solo
First and last author come from byline position, which some venues assign alphabetically.
Recent papers8
- Two Coupled Rejection Metrics Can Tell Adversarial Examples ApartAuthor 3 of 8CVPR 2022 · 13 citations
- Finding the Dominant Winning Ticket in Pre-Trained Language ModelsAuthor 2 of 8ACL Findings 2022 · 6 citations
- Rethinking Positional Encoding in Language Pre-trainingAuthor 2 of 3ICLR 2021 · 358 citations
- GraphNorm: A Principled Approach to Accelerating Graph Neural Network TrainingAuthor 4 of 6ICML 2021 · 224 citations
- How could Neural Networks understand Programs?Author 5 of 7ICML 2021 · 75 citations
- Stable, Fast and Accurate: Kernelized Attention with Relative Positional EncodingAuthor 4 of 9NeurIPS 2021 · 66 citations
- Less is More: Pretrain a Strong Siamese Encoder for Dense Text Retrieval Using a Weak DecoderAuthor 2 of 9EMNLP 2021 · 46 citations
- On Layer Normalization in the Transformer ArchitectureAuthor 3 of 10ICML 2020 · 1,388 citations
