Verb Class Induction with Partial Supervision
Abstract
Dirichlet-multinomial (D-M) mixtures like latent Dirichlet allocation (LDA) are widely used for both topic modeling and clustering. Prior work on constructing Levin-style semantic verb clusters achieves state-of-the-art results using D-M mixtures for verb sense induction and clustering. We add a bias toward known clusters by explicitly labeling a small number of observations with their correct VerbNet class. We demonstrate that this partial supervision guides the resulting clusters effectively, improving the recovery of both labeled and unlabeled classes by 16%, for a joint 12% absolute improvement in F1 score compared to clustering without supervision. The resulting clusters are also more semantically coherent. Although the technical change is minor, it produces a large effect, with important practical consequences for supervised topic modeling in general.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Related papers
- Topic Modeling Revisited: A Document Graph-based Neural Network PerspectiveDazhong Shen, Chuan Qin, Chao Wang, Zheng Dong et al.NeurIPS 2021 · 50 citations
- OTLDA: A Geometry-aware Optimal Transport Approach for Topic ModelingViet Huynh, He Zhao, Dinh PhungNeurIPS 2020 · 29 citations
- Image Clustering with External GuidanceYunfan Li, Peng Hu, Dezhong Peng, Jiancheng Lv et al.ICML 2024 · 33 citations
- Neural Topic Modeling with Bidirectional Adversarial TrainingRui Wang, Xuemeng Hu, Deyu Zhou, Yulan He et al.ACL 2020 · 77 citations
- TaxoCom: Topic Taxonomy Completion with Hierarchical Discovery of Novel Topic ClustersDongha Lee, Jiaming Shen, Seongku Kang, Susik Yoon et al.WWW 2022 · 46 citations
