CONTEXTOR: Contextualized High-order Contrastive Learning
Ze Cai, Hanzhe Liang, Sihang Zeng, Binbin Zhou, Jun Wen
Abstract
High-order relations involving multiple interacting entities are commonly encountered, particularly in biomedical domains. Existing relational learning methods typically learn static entity representations and assume symmetric relation inference, which can be inadequate for capturing context-dependent entity functions and the inherent asymmetry of high-order relations. In this paper, we propose Contextualized Highorder Contrastive Learning (CONTEXTOR), a general-purpose, plug-and-play framework that formulates high-order relation inference as a dynamic query-response process. Specifically, CONTEXTOR decomposes each high-order relation into multiple incomplete query tuples and their corresponding response entities. Given a query tuple, we contextualize candidate response entity representations via an asymmetric conditional modulation, and align queries with their corresponding contextualized responses through multi-fold contrastive learning. Extensive experiments on benchmark datasets spanning multiple biomedical tasks demonstrate that CONTEXTOR consistently outperforms existing methods across diverse evaluation settings. Code is available at https://github.com/ ZJUDataIntelligence/CONTEXTOR.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 908c6719-4344-4f8e-934b-d732ea65512cBuilds on7
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- PRODIGY: Enabling In-context Learning Over GraphsQian Huang, Hongyu Ren, Peng Chen, Gregor Krzmanc et al.NeurIPS 2023 · 131 citations
- Bi-level Contrastive Learning for Knowledge-Enhanced Molecule RepresentationsPengcheng Jiang, Cao Xiao, Tianfan Fu, Parminder Bhatia et al.AAAI 2025 · 7 citations
- Global Context-aware Representation Learning for Spatially Resolved TranscriptomicsYunhak Oh, Junseok Lee, Yeongmin Kim, Sangwoo Seo et al.ICML 2025
- ICLR: In-Context Learning of RepresentationsCore Francisco Park, Andrew Lee, Ekdeep Singh Lubana, Yongyi Yang et al.ICLR 2025
Related papers
- Self-Supervised Hypergraph Learning with Substructure Awareness for Hyperedge PredictionMing Li, Huiting Wang, Yuting Chen, Lu Bai et al.AAAI 2026
- Query-based Instance Discrimination Network for Relational Triple ExtractionZeqi Tan, Yongliang Shen, Xuming Hu, Wenqi Zhang et al.EMNLP 2022 · 10 citations
- THE MORE, THE MERRIER: CONTRASTIVE FUSION FOR HIGHER-ORDER MULTIMODAL ALIGNMENTStefanos Koutoupis, Michaela Areti Zervou, Konstantinos Kontras, Maarten De Vos et al.CVPR 2026 · 5 citations
- Optimizing Bi-Encoder for Named Entity Recognition via Contrastive LearningSheng Zhang, Hao Cheng, Jianfeng Gao, Hoifung PoonICLR 2023 · 22 citations
- Contrasting with Symile: Simple Model-Agnostic Representation Learning for Unlimited ModalitiesAdriel Saporta, Aahlad Manas Puli, Mark Goldstein, Rajesh RanganathNeurIPS 2024 · 28 citations
