ID-GMLM: Intelligent Decision-Making with Integrated Graph Models and Large Language Models
Zhenhua Meng, Fanshen Meng, Rongheng Lin, Budan Wu
Abstract
Multi-criteria decision making (MCDM) and preference learning (PL) are crucial subfields of intelligent decisionmaking, both aiming to aid decision-makers (DMs) in selecting, classifying, or ranking alternatives. While MCDM and PL can complement each other to some extent, existing approaches combining MCDM and PL often struggle with large data volumes and complex relational information. To address this, we propose a novel approach called ID-GMLM that integrates graph models and large language models (LLMs) for intelligent decision-making. It reformulates decision-making as a high-parallelism ranking function in the graph domain, using graph neural networks (GNNs) to learn and understand complex relationships between alternatives or criteria, and LLMs to parse and quantify the preferences of DMs. ID-GMLM features a multi-task learning framework that optimizes the primary task of predicting alternative rankings while modeling criterion interactions through the auxiliary task. Additionally, ID-GMLM incorporates a parameter tuning network based on criterion weights and an attention network, allowing the model to adaptively adjust to the context of the current task and the evolving preferences of DMs. Experiments on benchmark datasets demonstrate that ID-GMLM achieves significant performance improvements, inheriting the interpretability and intuitive appeal of MCDM while leveraging the computational efficiency and high accuracy of PL.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on11
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- Benchmarking Large Language Models in Retrieval-Augmented GenerationJiawei Chen, Hongyu Lin, Xianpei Han, Le SunAAAI 2024 · 531 citations
- Representation Learning with Large Language Models for RecommendationXubin Ren, Wei Wei, Lianghao Xia, Lixin Su et al.WWW 2024 · 385 citations
- Preference Ranking Optimization for Human AlignmentFeifan Song, Bowen Yu, Minghao Li, Haiyang Yu et al.AAAI 2024 · 357 citations
- Pretraining Language Models with Human PreferencesTomasz Korbak, Kejian Shi, Angelica Chen, Rasika Vinayak Bhalerao et al.ICML 2023 · 287 citations
Related papers
- Learning on Large-scale Text-attributed Graphs via Variational InferenceJianan Zhao, Meng Qu, Chaozhuo Li, Hao Yan et al.ICLR 2023 · 25 citations
- Can Graph Learning Improve Planning in LLM-based Agents?Xixi Wu, Yifei Shen, Caihua Shan, Kaitao Song et al.NeurIPS 2024 · 67 citations
- Judge and Improve: Towards a Better Reasoning of Knowledge Graphs with Large Language ModelsMo Zhiqiang, Yang Hua, Jiahui Li, Yuan Liu et al.EMNLP 2025
- GraphRouter: A Graph-based Router for LLM SelectionsTao Feng, Yanzhen Shen, Jiaxuan YouICLR 2025
- Killing Two Birds with One Stone: Cross-modal Reinforced Prompting for Graph and Language TasksWenyuan Jiang, Wenwei Wu, Le Zhang, Zixuan Yuan et al.KDD 2024 · 4 citations
