Adapter-TST: A Parameter Efficient Method for Multiple-Attribute Text Style Transfer

Adapting a large language model for multipleattribute text style transfer via fine-tuning can be challenging due to the substantial amount of computational resources and labeled data required for the specific downstream task.In this paper, we address this challenge by introducing Adapter-TST, a framework that freezes the pre-trained model's original parameters and enables the development of a multiple-attribute text style transfer model.Using BART or T5 as the backbone model, Adapter-TST utilizes different neural adapters to model different types of attribute information, similar to a plug-in connected to the base model.Our method allows control over multiple attributes (e.g.sentiment, tense, active or passive voice) and configures the adapters' architecture to generate multiple outputs in respect to attributes or compositional editing on the same sentence.We evaluate the proposed model on both traditional sentiment transfer and multiple-attribute transfer tasks.The experiment results demonstrate that Adapter-TST outperforms all the state-of-the-art baselines with significantly less computational resources.We have also empirically shown that each adapter is able to characterize specific stylistic attributes effectively and can be configured to perform compositional editing.The code and datasets can be found in https://github. com/Social-AI-Studio/Adapter-TST. Opponents don't buy such arguments. Such arguments aren't bought by opponents.Future Such arguments will not be bought by opponents. Opponents don't buy such arguments.Passive Future Such arguments will not be bought by opponents. Opponents don't buy such arguments. Passive Past FutureSuch arguments aren't bought by opponents.Opponents will not buy such arguments.