Hasso-Plattner-Institut
Prof. Dr. Jürgen Döllner
  
 

Sebastian Pasewaldt

Tel.: +49-(0)331 5509-3908
Fax: +49-(0)331 5509-172
Room: H-2.26
E-Mail: sebastian.pasewaldt@hpi.de

Research interests

  • 3D virtual city and landscape models
  • Interactive map-like 3D representations
  • Non-linear projections
  • Cognitive processing of 3D city models

Publications

Demo: Pictory - Neural Style Transfer and Editing with CoreML

Pasewaldt, Sebastian; Semmo, Amir; Klingbeil, Mandy; Döllner, Jürgen in Proceedings SIGGRAPH ASIA Mobile Graphics and Interactive Applications (MGIA) New York , ACM , 2017 .

This work presents advances in the design and implementation of Pictory, an iOS app for artistic neural style transfer and interactive image editing using the CoreML and Metal APIs. Pictory combines the benefits of neural style transfer, e.g., high degree of abstraction on a global scale, with the interactivity of GPU-accelerated stateof-the-art image-based artistic rendering on a local scale. Thereby, the user is empowered to create high-resolution, abstracted renditions in a two-stage approach. First, a photo is transformed using a pre-trained convolutional neural network to obtain an intermediate stylized representation. Second, image-based artistic rendering techniques (e.g., watercolor, oil paint or toon filtering) are used to further stylize the image. Thereby, fine-scale texture noise—introduced by the style transfer—is filtered and interactive means are provided to individually adjust the stylization effects at run-time. Based on qualitative and quantitative user studies, Pictory has been redesigned and optimized to support casual users as well as mobile artists by providing effective, yet easy to understand, tools to facilitate image editing at multiple levels of control.
[ DOI ]
Demo: Pictory - Neural St... - Download
Weitere Informationen
Tags cgs 

Talks

  • "Multiscale Visualization of 3D Geovirtual Environments Using View-Dependent Multi-Perspective Views" at the WSCG 2011, Plzen - Czech Republic (02/2011)
  • "Multiscale, Multi-Perspective Visualization of 3D City Models in Immersive Environments" at the opening ceremony of the 3D Lab Golm, Potsdam - Germany (06/2011)
  • "Multiperspective Visualizations of 3D Geovirtual Environments" - Joint Workshop of the HPI Research School for "Service-Oriented Systems Engineering", Cape Town - South Africa (04/2012)
  • "Towards Comprehensible Digital 3D Maps" - Symposium on Service-Oriented Mapping 2012 (SOMAP 2012), Vienna - Austria (11/2012)
  • "A Service-Oriented Platform for Interactive 3D Web Mapping" - Symposium on Service-Oriented Mapping 2012 (SOMAP 2012), Vienna - Austria (11/2012)
  • "Towards Comprehensible Service-Based 3D Maps" - HPI Symposium@SAP, Walldorf - Germany (12/2012)
  • "Potentials of and Approaches for Multi-Perspective Visualization of 3D Spatial Models", GeoViz 2013, Hamburg - Germany (03/2013)

Teaching activities

Winter term 2010/11

  • lecture "Informationsvisualisierung (informationvisualization) " (tutor)
  • course "Advanced Visualizationtechniques" (tutor)
  • pupils academy (co-lecturer)

Summer term 2011

  • lecture "Geovisualization" (tutor)

Winter term 2011/12

  • course "Realtime Rendering" (tutor)
  • pupils academy (co-lecturer)

Summer term 2012

  • course "Algorithmic Geometry" (tutor)
  • course "Geovisualization Techniques" (tutor)

Winter term 2012/13

  • course "Game Programming" (tutor)
  • course "Concepts and Techniques for 3D Visualization"
  • pupils academy (co-lecturer)

Summer term 2013

  • lecture "Geovisualization" (co-lecturer)
  • lecture "Interfaces of Geoinformation and Geocommunication" (tutor)