What are the Goals of Distributional Semantics?
Guy Emerson
Abstract
Distributional semantic models have become a mainstay in NLP, providing useful features for downstream tasks. However, assessing long-term progress requires explicit long-term goals. In this paper, I take a broad linguistic perspective, looking at how well current models can deal with various semantic challenges. Given stark differences between models proposed in different subfields, a broad perspective is needed to see how we could integrate them. I conclude that, while linguistic insights can guide the design of model architectures, future progress will require balancing the often conflicting demands of linguistic expressiveness and computational tractability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e5c0a5ec-7c81-4e4d-96d1-3ed129067c85Cited by top-tier papers6
- Climbing towards NLU: On Meaning, Form, and Understanding in the Age of DataEmily M. Bender, Alexander KollerACL 2020 · 914 citations
- Explainable Semantic Space by Grounding Language to Vision with Cross-Modal Contrastive LearningYizhen Zhang, Minkyu Choi, Kuan Han, Zhongming LiuNeurIPS 2021 · 20 citations
- Autoencoding Pixies: Amortised Variational Inference with Graph Convolutions for Functional Distributional SemanticsGuy EmersonACL 2020 · 8 citations
- Learning Functional Distributional Semantics with Visual DataYinhong Liu, Guy EmersonACL 2022 · 2 citations
- Distributional Inclusion Hypothesis and Quantifications: Probing for Hypernymy in Functional Distributional SemanticsChun Hei Lo, Wai Lam, Hong Cheng, Guy EmersonACL 2024
Builds on4
- Climbing towards NLU: On Meaning, Form, and Understanding in the Age of DataEmily M. Bender, Alexander KollerACL 2020 · 914 citations
- A Mutual Information Maximization Perspective of Language Representation LearningLingpeng Kong, Cyprien de Masson d'Autume, Lei Yu, Wang Ling et al.ICLR 2020 · 179 citations
- Modelling Semantic Categories Using Conceptual NeighborhoodZied Bouraoui, José Camacho-Collados, Luis Espinosa Anke, Steven SchockaertAAAI 2020 · 10 citations
- Autoencoding Pixies: Amortised Variational Inference with Graph Convolutions for Functional Distributional SemanticsGuy EmersonACL 2020 · 8 citations
Related papers
- Hybrid Semantics for Goal-Directed Natural Language GenerationConnor Baumler, Soumya RayACL 2022
- The King Is Naked: On the Notion of Robustness for Natural Language ProcessingEmanuele La Malfa, Marta KwiatkowskaAAAI 2022 · 31 citations
- ProgressLM: Towards Progress Reasoning in Vision-Language ModelsJianshu Zhang, Chengxuan Qian, Haosen Sun, Haoran Lu et al.ACL 2026 · 7 citations
- In Benchmarks We Trust ... Or Not?Ine Gevers, Victor De Marez, Jens Van Nooten, Jens Lemmens et al.EMNLP 2025 · 1 citation
- Revisiting a Pain in the Neck: A Semantic Reasoning Benchmark for Language ModelsYang Liu, Hongming Li, Melissa Xiaohui Qin, Chao Huang et al.ACL 2026
