Hasso-Plattner-Institut
Prof. Dr. Jürgen Döllner
  
 

Sebastian Pasewaldt

Tel.: +49-(0)331 5509-3908
Fax: +49-(0)331 5509-172
Room: H-2.26
E-Mail: sebastian.pasewaldt@hpi.de

Research interests

  • 3D virtual city and landscape models
  • Interactive map-like 3D representations
  • Non-linear projections
  • Cognitive processing of 3D city models

Publications

MaeSTrO: A Mobile App for Style Transfer Orchestration using Neural Networks

Reimann, Max; Klingbeil, Mandy; Pasewaldt, Sebastian; Semmo, Amir; Trapp, Matthias; Döllner, Jürgen in Proceedings International Conference on Cyberworlds Seite 9-16 . IEEE , 2018 .

Mobile expressive rendering gained increasing popularity amongst users seeking casual creativity by image stylization and supports the development of mobile artists as a new user group. In particular, the neural style transfer has advanced as a core technology to emulate characteristics of manifold artistic styles and media without deep prior knowledge of photo processing or editing. However, when it comes to creative expression, the technology still faces inherent limitations in providing low-level controls for localized image stylization, e.g., with respect to image feature semantics or the user's ideas and interest. The goal of this work is to implement and enhance state-of-the-art neural style transfer techniques, providing a generalized user interface with interactive tools for local control that facilitate a creative editing process on mobile devices. At this, we first propose a problem characterization consisting of three goals that represent a trade-off between visual quality, run-time performance and ease of control. We then present MaeSTrO, a mobile app for orchestration of three neural style transfer techniques using iterative, multi-style generative and adaptive neural networks that can be locally controlled by on-screen painting metaphors to direct a semantics-based composition and perform location-based filtering. Based on first user tests, we conclude with insights, showing different levels of satisfaction for the implemented techniques and user interaction design, pointing out directions for future research.
[ DOI ]
MaeSTrO: A Mobile App for... - Download
Weitere Informationen
Tags cgs  myown 

Talks

  • "Multiscale Visualization of 3D Geovirtual Environments Using View-Dependent Multi-Perspective Views" at the WSCG 2011, Plzen - Czech Republic (02/2011)
  • "Multiscale, Multi-Perspective Visualization of 3D City Models in Immersive Environments" at the opening ceremony of the 3D Lab Golm, Potsdam - Germany (06/2011)
  • "Multiperspective Visualizations of 3D Geovirtual Environments" - Joint Workshop of the HPI Research School for "Service-Oriented Systems Engineering", Cape Town - South Africa (04/2012)
  • "Towards Comprehensible Digital 3D Maps" - Symposium on Service-Oriented Mapping 2012 (SOMAP 2012), Vienna - Austria (11/2012)
  • "A Service-Oriented Platform for Interactive 3D Web Mapping" - Symposium on Service-Oriented Mapping 2012 (SOMAP 2012), Vienna - Austria (11/2012)
  • "Towards Comprehensible Service-Based 3D Maps" - HPI Symposium@SAP, Walldorf - Germany (12/2012)
  • "Potentials of and Approaches for Multi-Perspective Visualization of 3D Spatial Models", GeoViz 2013, Hamburg - Germany (03/2013)

Teaching activities

Winter term 2010/11

  • lecture "Informationsvisualisierung (informationvisualization) " (tutor)
  • course "Advanced Visualizationtechniques" (tutor)
  • pupils academy (co-lecturer)

Summer term 2011

  • lecture "Geovisualization" (tutor)

Winter term 2011/12

  • course "Realtime Rendering" (tutor)
  • pupils academy (co-lecturer)

Summer term 2012

  • course "Algorithmic Geometry" (tutor)
  • course "Geovisualization Techniques" (tutor)

Winter term 2012/13

  • course "Game Programming" (tutor)
  • course "Concepts and Techniques for 3D Visualization"
  • pupils academy (co-lecturer)

Summer term 2013

  • lecture "Geovisualization" (co-lecturer)
  • lecture "Interfaces of Geoinformation and Geocommunication" (tutor)