Reinforcement Tuning for Detecting Stances and Debunking Rumors Jointly with Large Language Models

Learning multi-task models for jointly detecting stance and verifying rumors poses challenges due to the need for training data of stance at post level and rumor veracity at claim level, which are difficult to obtain. To address this issue, we leverage large language models (LLMs) as the foundation annotators for the joint stance detection (SD) and rumor verification (RV) tasks, dubbed as JSDRV. We introduce a novel reinforcement tuning framework to enhance the joint predictive capabilities of LLM-based SD and RV components. Specifically, we devise a policy for selecting LLMannotated data at the two levels, employing a hybrid reward mechanism to choose highquality labels for effective LLM fine-tuning on both tasks. Results demonstrate that JSDRV improves the capabilities of LLMs in the joint tasks, not only outperforming state-of-the-art methods but also generalizing to non-LLMs accommodated as task models. * Jing Ma is the corresponding author. SMU Classification: Restricted Claim: WOW! It appears that leaked emails have revealed Melania Trump's apparent threats of divorce towards Donald Trump, along with her inquiries about his pension and the terms she would be entitled to in a $2 billion divorce settlement. p1: Only on social media.