Unsupervised Text Style Transfer through Style Embedding

Author(s)
김희진
Alternative Author(s)
Heejin Kim
Advisor
손경아
Department
일반대학원 인공지능학과
Publisher
The Graduate School, Ajou University
Publication Year
2021-02
Language
eng
Keyword
Deep learningNatural language processingText generationText style transfer
Alternative Abstract
Unsupervised text style transfer problem is to generate a sentence that reflects the newly given style while preserving the content of the input sentence. It also aims to generate sentences naturally. Text style transfer has been solved by a supervised method using a parallel dataset (Jhamtani, 2017). However, there is a difficulty in that there are few data corresponding to each other for each style domain, and because of this, information on the parts to be preserved and the parts to be changed is not clear when the domain is transferred. So, it is difficult to avoid losing content when focusing on style change. The primary approach to solve this problem is disentanglement between content and style (Shen, 2017; Hu, 2017; Fu, 2018; John, 2019). This approach changes only the information about the style to keep the content. Other approaches do not separate style and content. Instead, a style classifier is used to change sentences’ style. However, there is only one output generated by both approaches. Therefore, neither approach can adjust the strength of the style. Also, the model from the previous approach typically does two things, sentence reconstruction, and style control. It complicates the overall architecture of the model. We utilize the Transformer-based autoencoder model for sentence generation, and the style embedding is learned in the style module, directly. This separation allows each module to concentrate more on its own duty. Moreover, we can control the style strength of the generated sentence by adjusting the style embedding. Therefore, our approach can alter the style strength and simplify the model architecture. In addition, experimental results prove that our approach excels in style transfer performance and content retention performance.
URI
https://dspace.ajou.ac.kr/handle/2018.oak/20074
Fulltext

Appears in Collections:
Graduate School of Ajou University > Department of Artificial Intelligence > 3. Theses(Master)
Files in This Item:
There are no files associated with this item.
Export
RIS (EndNote)
XLS (Excel)
XML

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Browse