Prof. Dr. Jürgen Döllner


Paper accepted for Expressive 2017

The paper "Neural Style Transfer: A Paradigm Shift for Image-based Artistic Rendering?" by Amir Semmo, Tobias Isenberg, and Jürgen Döllner has been accepted as a contribution to the the joint Expressive Symposium (CAe, NPAR, SBIM). Expressive 2017 will be held in Los Angeles, CA, USA from the 29th to 30th of July and is co-located with SIGGRAPH 2017.



In this meta paper we discuss image-based artistic rendering (IB-AR) based on neural style transfer (NST) and argue, while NST may represent a paradigm shift for IB-AR, that it also has to evolve as an interactive tool that considers the design aspects and mechanisms of artwork production. IB-AR received significant attention in the past decades for visual communication, covering a plethora of techniques to mimic the appeal of artistic media. Example-based rendering (EBR) represents one the most promising paradigms in IB-AR to (semi-)automatically simulate artistic media with high fidelity, but so far has been limited because it relies on pre-defined image pairs for training or informs only low-level image features for texture transfers. Recent advancements in deep convolutional neural networks showed to alleviate these limitations by separating image contents from style, thus making a generalized style transfer practicable. We categorize style transfers within the taxonomy of IB-AR, then propose a semiotic model to derive a technical research agenda for NSTs with respect to the grand challenges of NPAR. We finally discuss the potentials of NSTs, thereby identifying applications such as casual creativity and art production.