Profiles2021-2024
Mostafa Dehghani
Google Deepmind
21Papers
3Last author
39Unique co-authors
3First author
0Solo
First and last author come from byline position, which some venues assign alphabetically.
Recent papers21
- Fractal Patterns May Illuminate the Success of Next-Token PredictionAuthor 3 of 3NeurIPS 2024 · 8 citations
- The Impact of Group Membership Bias on the Quality and Fairness of Exposure in RankingAuthor 4 of 4SIGIR 2024 · 2 citations
- Scaling Vision Transformers to 22 Billion ParametersAuthor 1 of 42ICML 2023 · 848 citations
- UL2: Unifying Language Learning ParadigmsAuthor 2 of 14ICLR 2023 · 97 citations
- Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?Author 2 of 10EMNLP Findings 2023 · 34 citations
- Adaptive Computation with Elastic Input SequenceAuthor 5 of 6ICML 2023 · 27 citations
- Transcending Scaling Laws with 0.1% Extra ComputeAuthor 17 of 17EMNLP 2023 · 27 citations
- -DARTS: Mitigating Performance Collapse by Harmonizing Operation Selection among CellsAuthor 5 of 7ICLR 2023
- Transformer Memory as a Differentiable Search IndexAuthor 3 of 13NeurIPS 2022 · 506 citations
- Exploring the Limits of Large Scale Pre-trainingAuthor 2 of 4ICLR 2022 · 135 citations
- The Efficiency MisnomerAuthor 1 of 5ICLR 2022 · 116 citations
- Scale Efficiently: Insights from Pretraining and Finetuning TransformersAuthor 2 of 10ICLR 2022 · 67 citations
- Discrete Representations Strengthen Vision Transformer RobustnessAuthor 3 of 6ICLR 2022 · 47 citations
- SCENIC: A JAX Library for Computer Vision Research and BeyondAuthor 1 of 4CVPR 2022 · 30 citations
- ViViT: A Video Vision TransformerAuthor 2 of 6ICCV 2021 · 2,947 citations
- Long Range Arena : A Benchmark for Efficient TransformersAuthor 2 of 10ICLR 2021 · 881 citations
- TokenLearner: Adaptive Space-Time Tokenization for VideosAuthor 4 of 5NeurIPS 2021 · 274 citations
- IDF++: Analyzing and Improving Integer Discrete Flows for Lossless CompressionAuthor 3 of 5ICLR 2021 · 38 citations
- OmniNet: Omnidirectional Representations from TransformersAuthor 2 of 9ICML 2021 · 33 citations
- Are Pretrained Convolutions Better than Pretrained Transformers?Author 2 of 7ACL 2021
- Parameter-efficient Multi-task Fine-tuning for Transformers via Shared HypernetworksAuthor 3 of 4ACL 2021
