Attention is All They Need: Exploring the Media Archaeology of the Computer Vision Research Paper
Samuel Goree, Gabriel Appleby, David Crandall, Norman Makoto Su
Abstract
Research papers, in addition to textual documents, are a designed interface through which researchers communicate. Recently, rapid growth has transformed that interface in many fields of computing. In this work, we examine the effects of this growth from a media archaeology perspective, through the changes to figures and tables in research papers. Specifically, we study these changes in computer vision over the past decade, as the deep learning revolution has driven unprecedented growth in the discipline. We ground our investigation through interviews with veteran researchers spanning computer vision, graphics, and visualization. Our analysis focuses on the research attention economy: how research paper elements contribute towards advertising, measuring, and disseminating an increasingly commodified "contribution." Through this work, we seek to motivate future discussion surrounding the design of both the research paper itself as well as the larger sociotechnical research publishing system, including tools for finding, reading, and writing research papers.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on24
- CoAtNet: Marrying Convolution and Attention for All Data SizesZihang Dai, Hanxiao Liu, Quoc V. Le, Mingxing TanNeurIPS 2021 · 1,747 citations
- Q-Diffusion: Quantizing Diffusion ModelsXiuyu Li, Yijiang Liu, Long Lian, Huanrui Yang et al.ICCV 2023 · 279 citations
- Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset DevelopmentMorgan Klaus Scheuerman, Alex Hanna, Emily DentonCSCW 2021 · 169 citations
- Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and SymbolsAndrew Head, Kyle Lo, Dongyeop Kang, Raymond Fok et al.CHI 2021 · 91 citations
- Affective Learning Objectives for Communicative VisualizationsElsie Lee-Robbins, Eytan AdarIEEE VIS 2022 · 83 citations
Related papers
- The Affective Growth of Computer VisionNorman Makoto Su, David J. CrandallCVPR 2021
- AttentionViz: A Global View of Transformer AttentionCatherine Yeh, Yida Chen, Aoyu Wu, Cynthia Chen et al.IEEE VIS 2023 · 78 citations
- Is Attention Explanation? An Introduction to the DebateAdrien Bibal, Rémi Cardon, David Alfter, Rodrigo Wilkens et al.ACL 2022
- A Scanner Deeply: Predicting Gaze Heatmaps on Visualizations Using Crowdsourced Eye Movement DataSungbok Shin, Sunghyo Chung, Sanghyun Hong, Niklas ElmqvistIEEE VIS 2022 · 21 citations
- The Elephant in the Room: Analyzing the Presence of Big Tech in Natural Language Processing ResearchMohamed Abdalla, Jan Philip Wahle, Terry Lima Ruas, Aurélie Névéol et al.ACL 2023 · 16 citations
