Cognitive Enhancement Chain-of-Thought Towards Enhancing Style Learning and Content Preservation for Long Style Transfer
Lianwei Wu, Botao Wang, Wenbo An, Tieqiao Li, Xianghua Li
Abstract
Current text style transfer task mainly focuses on short texts, while the field has not been fully developed for long texts. Considering the richer semantics and more complex sentence structures in long text sequences, existing methods that employ traditional style-content disentanglement ways and learn the target style to generate target sequences face two key issues: 1) During disentanglement, they usually directly separate style words or fragments, such coarse-grained disentanglement risks losing original semantics and hinder the model's content preservation. 2) During target style learning, they often focus on the transfer of certain style attributes or aspects, which makes it difficult to grasp the holistic style of target objects. To this end, we propose Cognitive enhancement Chain-of-Thought (CeCoT) towards enhancing style learning and content preservation for long style transfer. Ce-CoT first constructs progressive CoT to facilitate LLMs to gradually rewrite source content and separate source styles, thereby enhancing the retention of original content. Then, we propose cognitive CoT, which comprehensively considers hierarchical cognitive content (i.e., shallower-deeper-normal level) and cognitive behavior (i.e., prompt order of CoT) to learn the overall target style. To enhance the robustness of our model, we also propose two constraint losses in a dual validation way towards content preservation enhancing and style consistency learning. Extensive experiments on two competitive datasets demonstrate the superiority of our CeCoT.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on19
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and EditingDongxu Li, Junnan Li, Steven C. H. HoiNeurIPS 2023 · 587 citations
- RLPrompt: Optimizing Discrete Text Prompts with Reinforcement LearningMingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, Yihan Wang et al.EMNLP 2022 · 141 citations
- A Probabilistic Formulation of Unsupervised Text Style TransferJunxian He, Xinyi Wang, Graham Neubig, Taylor Berg-KirkpatrickICLR 2020 · 136 citations
- Expressive Text-to-Image Generation with Rich TextSongwei Ge, Taesung Park, Jun-Yan Zhu, Jia-Bin HuangICCV 2023 · 102 citations
Related papers
- Disentangled Learning with Synthetic Parallel Data for Text Style TransferJingxuan Han, Quan Wang, Zikang Guo, Benfeng Xu et al.ACL 2024 · 4 citations
- SC2: Towards Enhancing Content Preservation and Style Consistency in Long Text Style TransferJie Zhao, Ziyu Guan, Cai Xu, Wei Zhao et al.ACL 2024
- UniCoTT: A Unified Framework for Structural Chain-of-Thought DistillationXianwei Zhuang, Zhihong Zhu, Zhichang Wang, Xuxin Cheng et al.ICLR 2025
- StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content EnhancingXuekai Zhu, Jian Guan, Minlie Huang, Juan LiuACL 2023 · 5 citations
- Long-Context Reasoning Through Proxy-Based Chain-of-Thought TuningMiao Li, Irina Saparina, Alexander Gurung, Mirella LapataACL 2026
