Profiles2021-2023
Donald Metzler
University of Pennsylvania
12Papers
10Last author
13Unique co-authors
0First author
0Solo
First and last author come from byline position, which some venues assign alphabetically.
Recent papers12
- UL2: Unifying Language Learning ParadigmsAuthor 14 of 14ICLR 2023 · 97 citations
- Transformer Memory as a Differentiable Search IndexAuthor 13 of 13NeurIPS 2022 · 506 citations
- ExT5: Towards Extreme Multi-Task Scaling for Transfer LearningAuthor 15 of 16ICLR 2022 · 237 citations
- Scarf: Self-Supervised Contrastive Learning using Random Feature CorruptionAuthor 4 of 4ICLR 2022 · 233 citations
- Charformer: Fast Character Transformers via Gradient-based Subword TokenizationAuthor 10 of 10ICLR 2022 · 198 citations
- Scale Efficiently: Insights from Pretraining and Finetuning TransformersAuthor 10 of 10ICLR 2022 · 67 citations
- Stretching Sentence-pair NLI Models to Reason over Long Documents and ClustersAuthor 5 of 5EMNLP Findings 2022 · 17 citations
- Long Range Arena : A Benchmark for Efficient TransformersAuthor 10 of 10ICLR 2021 · 881 citations
- HyperGrid Transformers: Towards A Single Model for Multiple TasksAuthor 4 of 5ICLR 2021 · 44 citations
- OmniNet: Omnidirectional Representations from TransformersAuthor 9 of 9ICML 2021 · 33 citations
- How Reliable are Model Diagnostics?Author 3 of 3ACL Findings 2021 · 15 citations
- Are Pretrained Convolutions Better than Pretrained Transformers?Author 7 of 7ACL 2021
