Hasso-Plattner-Institut
  
Hasso-Plattner-Institut
Prof. Dr. Jürgen Döllner
  
 

Flow-based Image and Video Abstraction

This project investigates automatic non-photorealistic image processing techniques for the creation of simplified stylistic illustrations from color images, videos and 3D renderings based on the bilateral and difference of Gaussians filters.

Our method extends the approach of [Winnemöller et al. 2006] to use iterated bilateral filtering for abstraction and difference-of-Gaussians (DoG) for edge extraction by adapting it to the local orientation of the input. To represent local orientation we construct a smooth tensor field. From the eigenvectors of this tensor field we derive a vector field that has similar characteristics as the edge tangent flow (ETF) of [Kang et al. 2007], but its computation is much less expensive. Besides gradient calculation, only smoothing with a box or Gaussian filter is necessary. In contrast to that, ETF construction requires several iterations of a nonlinear filter with large filter kernel.

The xy-separated bilateral filter [Pham and van Vliet 2005] used by Winnemöller et al. suffers from horizontal and vertical artifacts. These artifacts appear in particular when the filter is applied iteratively. Our approach works by first filtering in direction of the gradient and then filtering the intermediate result in perpendicular direction. When applied iteratively our approach does not suffer from horizontal or vertical artifacts and creates smooth output at curved boundaries.

DoG edges often look frayed and don’t reassemble straight line and curve segments very well. To work around this limitation, [Kang et al. 2007] recently introduced the concept of flow-based difference-of-Gaussians which, compared to DoG edges, create more coherent lines. They replaced the DoG filter by a flow-guided anisotropic kernel whose shape is defined by the ETF. Comparable high-quality results can be achieved by a separated implementation with corresponding reduced computational complexity. We first apply a one-dimensional difference-of- Gaussian filter in direction of the gradient and then apply smoothing along the vector field that we derive from the smoothed structure tensor.

Publications

Approaches to Image Abstraction for Photorealistic Depictions of Virtual 3D Models

Döllner, Jürgen and Kyprianidis, Jan Eric
In Georg Gartner and Felix Ortag, ed., Proceedings of the First ICA Symposium for Central and Eastern Europe 2009, pages 371–385, 2009 Vienna University of Technology,

Abstract:

In our contribution, we present approaches of automatic image abstraction, applied to images and image sequences derived as views of virtual 3D city models and landscape models. We first discuss the requirements of cartography-specific visualization based on the virtual globe metaphor as well as the specific characteristics and deficiencies of visualization based on photorealism. We introduce a concept that extends the classical visualization pipeline by cartography-specific functionality, object-space and image-space abstraction, which also represent the two principle ways for implementing cartographic visualization systems. Abstraction provides the prerequisites to visually communicate uncertainty, to simplify and filter detailed elements, and to clearly encode displayed information of complex geospatial information. In addition, it offers many degrees of freedoms for artistic and stylistic design of cartographic products. Furthermore, we outline general working principles and implementation of an automatic image-space abstraction technique we developed that creates high-quality, simplified, stylistic illustrations from color images, videos, and 3D renderings.

BibTeX file

@inproceedings{DK09,
author = { D{\"o}llner, J{\"u}rgen and Kyprianidis, Jan Eric },
title = { Approaches to Image Abstraction for Photorealistic Depictions of Virtual 3D Models },
year = { 2009 },
pages = { 371--385 },
month = { 0 },
abstract = { In our contribution, we present approaches of automatic image abstraction, applied to images and image sequences derived as views of virtual 3D city models and landscape models. We first discuss the requirements of cartography-specific visualization based on the virtual globe metaphor as well as the specific characteristics and deficiencies of visualization based on photorealism. We introduce a concept that extends the classical visualization pipeline by cartography-specific functionality, object-space and image-space abstraction, which also represent the two principle ways for implementing cartographic visualization systems. Abstraction provides the prerequisites to visually communicate uncertainty, to simplify and filter detailed elements, and to clearly encode displayed information of complex geospatial information. In addition, it offers many degrees of freedoms for artistic and stylistic design of cartographic products. Furthermore, we outline general working principles and implementation of an automatic image-space abstraction technique we developed that creates high-quality, simplified, stylistic illustrations from color images, videos, and 3D renderings. },
editor = { Georg Gartner and Felix Ortag },
booktitle = { Proceedings of the First ICA Symposium for Central and Eastern Europe 2009 },
organization = { Vienna University of Technology },
priority = { 0 }
}

Copyright Notice

last change: Tue, 29 Mar 2011 11:37:48 +0200

Links