MCPG: A Flexible Multi-Level Controllable Framework for Unsupervised Paraphrase Generation

We present MCPG: a simple and effective approach for controllable unsupervised paraphrase generation, which is also flexible to adapt to specific domains without extra training. MCPG is controllable in different levels: local lexicons, global semantics, and universal styles. The unsupervised paradigm of MCPG combines factual keywords and diversified semantic embeddings as local lexical and global semantic constraints. The semantic embeddings are diversified by standard dropout, which is exploited for the first time to increase inference diversity by us. Moreover, MCPG is qualified with good domain adaptability by adding a transfer vector as a universal style constraint, which is refined from the exemplars retrieved from the corpus of the target domain in a training-free way. Extensive experiments show that MCPG outperforms state-of-the-art unsupervised baselines by a margin. Meanwhile, our domain-adapted MCPG also achieves competitive performance with strong supervised baselines even without training. Semantic Encoder Keyword Selector What is it like to study in McGill University? McGill University Semantic Embed Generator • (dp=0.10) What is it like to study at McGill University ? • (dp=0.12) What is it like to study , to be at McGill University ? • (dp=0.16) What does it mean to study like this inside McGill University ? • (dp=0.22) What is it like to be a student in McGill University ?