Lune

Profiles2021-2023

Donald Metzler

University of Pennsylvania

12Papers
10Last author
13Unique co-authors
0First author
0Solo

First and last author come from byline position, which some venues assign alphabetically.

Recent papers12

  1. UL2: Unifying Language Learning ParadigmsAuthor 14 of 14ICLR 2023 · 97 citations
  2. Transformer Memory as a Differentiable Search IndexAuthor 13 of 13NeurIPS 2022 · 506 citations
  3. ExT5: Towards Extreme Multi-Task Scaling for Transfer LearningAuthor 15 of 16ICLR 2022 · 237 citations
  4. Scarf: Self-Supervised Contrastive Learning using Random Feature CorruptionAuthor 4 of 4ICLR 2022 · 233 citations
  5. Charformer: Fast Character Transformers via Gradient-based Subword TokenizationAuthor 10 of 10ICLR 2022 · 198 citations
  6. Scale Efficiently: Insights from Pretraining and Finetuning TransformersAuthor 10 of 10ICLR 2022 · 67 citations
  7. Stretching Sentence-pair NLI Models to Reason over Long Documents and ClustersAuthor 5 of 5EMNLP Findings 2022 · 17 citations
  8. Long Range Arena : A Benchmark for Efficient TransformersAuthor 10 of 10ICLR 2021 · 881 citations
  9. HyperGrid Transformers: Towards A Single Model for Multiple TasksAuthor 4 of 5ICLR 2021 · 44 citations
  10. OmniNet: Omnidirectional Representations from TransformersAuthor 9 of 9ICML 2021 · 33 citations
  11. How Reliable are Model Diagnostics?Author 3 of 3ACL Findings 2021 · 15 citations
  12. Are Pretrained Convolutions Better than Pretrained Transformers?Author 7 of 7ACL 2021
Dusk over the sea between two cliffs drawn in fine vertical lines