Lune

ACL Findings2024

SymTax: Symbiotic Relationship and Taxonomy Fusion for Effective Citation Recommendation

Karan Goyal, Mayank Goel, Vikram Goyal, Mukesh K. Mohania

Abstract

Citing pertinent literature is pivotal to writing and reviewing a scientific document. Existing techniques mainly focus on the local context or the global context for recommending citations but fail to consider the actual human citation behaviour. We propose SymTax, a three-stage recommendation architecture that considers both the local and the global context, and additionally the taxonomical representations of querycandidate tuples and the Symbiosis prevailing amongst them. SymTax learns to embed the infused taxonomies in the hyperbolic space and uses hyperbolic separation as a latent feature to compute query-candidate similarity. We build a novel and large dataset ArSyTa containing 8.27 million citation contexts and describe the creation process in detail. We conduct extensive experiments and ablation studies to demonstrate the effectiveness and design choice of each module in our framework. Also, combinatorial analysis from our experiments shed light on the choice of language models (LMs) and fusion embedding, and the inclusion of section heading as a signal. Our proposed module that captures the symbiotic relationship solely leads to performance gains of 26.66% and 39.25% in Recall@5 w.r.t. SOTA on ACL-200 and RefSeer datasets, respectively. The complete framework yields a gain of 22.56% in Recall@5 wrt SOTA on our proposed dataset. The code and dataset are available at https://github.com/goyalkaraniit/SymTax.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • CiteBART: Learning to Generate Citations for Local Citation Recommendation cites SPECTER: Document-level Representation Learning using Citation-informed Transformers
  • Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings cites SPECTER: Document-level Representation Learning using Citation-informed Transformers
  • DisenCite: Graph-Based Disentangled Representation Learning for Context-Specific Citation Generation cites SPECTER: Document-level Representation Learning using Citation-informed Transformers
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. CiteBART: Learning to Generate Citations for Local Citation RecommendationEge Yigit Çelik, Selma TekirEMNLP 2025 · 5 citations
  2. AgentExpt: Automating AI Experiment Design with LLM-based Resource Retrieval AgentYu Li, Lehui Li, Lin Chen, Qingmin Liao et al.ICML 2026 · 2 citations

Builds on5

  1. Hyperbolic Neural Networks++Ryohei Shimizu, Yusuke Mukuta, Tatsuya HaradaICLR 2021 · 791 citations
  2. Neighborhood Contrastive Learning for Scientific Document Representations with Citation EmbeddingsMalte Ostendorff, Nils Rethmeier, Isabelle Augenstein, Bela Gipp et al.EMNLP 2022 · 46 citations
  3. DisenCite: Graph-Based Disentangled Representation Learning for Context-Specific Citation GenerationYifan Wang, Yiping Song, Shuai Li, Chaoran Cheng et al.AAAI 2022 · 42 citations
  4. SPECTER: Document-level Representation Learning using Citation-informed TransformersArman Cohan, Sergey Feldman, Iz Beltagy, Doug Downey et al.ACL 2020 · 20 citations
  5. Towards Consistency in Adversarial ClassificationLaurent Meunier, Raphael Ettedgui, Rafael Pinot, Yann Chevaleyre et al.NeurIPS 2022 · 12 citations

Related papers

  1. HyperExpan: Taxonomy Expansion with Hyperbolic Representation LearningMingyu Derek Ma, Muhao Chen, Te-Lin Wu, Nanyun PengEMNLP Findings 2021 · 15 citations
  2. Where are we in embedding spaces?Sixiao Zhang, Hongxu Chen, Xiao Ming, Lizhen Cui et al.KDD 2021 · 31 citations
  3. Large Language Models Enhanced Hyperbolic Space Recommender SystemsWentao Cheng, Zhida Qin, Zexue Wu, Pengzhan Zhou et al.SIGIR 2025 · 6 citations
  4. Bringing Motion Taxonomies to Continuous Domains via GPLVM on Hyperbolic manifoldsNoémie Jaquier, Leonel Rozo, Miguel González Duque, Viacheslav Borovitskiy et al.ICML 2024 · 11 citations
  5. Hyperbolic RQ-VAE enhanced Generative Recommendation with Differential-Length Codebook StrategyAoran Zhang, Yu-Bin Yang, Yonghong YuICML 2026
Dusk over the sea between two cliffs drawn in fine vertical lines