Prof. Dr. Jürgen Döllner

Software Analysis and Visualization

Automated software analysis and visualization is concerned with giving insight into complex, large-scale, existing software systems ("legacy systems") and their static structure, dynamic behavior, and evolution. We address this need in industry by developing methods and techniques that support and automate the analysis and visualization of software systems.

Various technologies have been developed by the computer graphics systems research group of the Hasso-Plattner-Institute. The technologies tackle core challenges in the development and maintenance of complex software systems and aim at creating transparency during development, reducing costs, and decreasing quality-related risks.


In-Browser Demo of Circular Bundleviews


Software Mining Technology

Software Mining aims at extracting, analyzing, and interpreting information extracted about complex IT systems and their implementations in order to provide explorative and analytical insights into structure, evolution, and dynamics of these systems.

Software Mining facilitates processes in software engineering, contributes to cope with the significant risks of developing new and maintaining existing IT systems. Research in that field develops essential tools, techniques, and methods to effectively manage the complexity of future IT-based systems in our society.

Software Quality Assessment and Monitoring Technology

Software Quality Assessment and Monitoring are specialized Software Mining Technologies being applied on quality-related information on complex software systems. Such information include quality-related code metrics, metrics about code modifications, i.e., about the system evolution, and on the code coverage of test suites executed at runtime. Quality Assessment is applied to obtain an initial view on the software system’s quality. Quality Monitoring serves as a “quality cockpit” that permits project managers to identify problematic development situations at an early stage.

Software Quality Assessment and Monitoring are essential technologies that help project managers to speed up software development and maintenance of complex software systems in the long run. It permits to effectively analyze which parts of the source code unnecessarily produces costs and increase risk due to low quality. Hence, the technologies permit project managers to focus resources and tackle the real quality problems, that is, those that are error-prone and slow down the development.

Software Architecture Recovery Technology

Software Architecture Recovery aims at revealing the architecture of long-living (legacy) software systems as it is implemented in the code. Hence, Software Architecture Recovery is a specialized variant of Software Mining Technology, where architecture-related information is extracted from the source code, from runtime events, or from the repository that keeps track of code changes. This implicit architectural information is visualized in a way such that both modular structures and dependency relations become visible.

The architecture as it is implemented in the code, typically, differs significantly from models contained in design time documents. However, developers need to understand the implemented architecture before they modify code. Otherwise they introduce design anomalies and couplings that make it difficult to maintain the system. Software Architecture Recovery shows the architecture as it is, and by this, it speeds up development and reduces the risk of introducing bugs due to misunderstood architectural guidelines.

Software Tracing Technology

Software Tracing is a technology to collect information about the behavior of a software system at execution time. Such information includes runtime data such as control flow information, e.g., function entry and exit events, or data on the state of the system, e.g., values being written into or being transferred between variables. Trace data is obtained by instrumenting the binary code of the software system. That is, the binary code is augmented with code that generates runtime events and serializes the data for further processing.

The tracing techniques having been developed by us use different instrumentation mechanisms that depend on the programming language and the runtime environment of the analyzed software system, e.g., native C/C++ on the Windows OS or Java-based components being executed within an application server.

Software tracing helps developers and maintainers to understand the runtime behavior of a software system, which would otherwise be difficult to be inspected. As an understanding of the runtime behavior is a prerequisite for a variety of software engineering tasks and software tracing can speed up the understanding process, the technology is helpful for software engineering tasks such as debugging, adapting existing features, or performance tuning. Software tracing is particularly helpful when long-living systems are concerned due to the typically existing lack of up-to-date documentation that developers could consult for speeding up the comprehension process.

C/C++ Software Tracing Technology

C/C++ software tracing enables developers and also end-users to create traces, i.e., time-ordered collections of runtime events, from a C/C++ software system running natively on the operation system (e.g., Windows). The technology performs a combination of compile-time and execution-time instrumentation to enable users to switch the runtime event collection mechanism on and off at any point in time during execution. During the switching step, which takes less than some seconds, binary code of the running software system is augmented with additional code that creates and collects runtime events. While the mechanism is switched off, no performance overhead is experienced.

This technology is useful in kinds of situations: when the software system is executed in a test environment by developers and when it is executed on the customer’s site in the production environment.

During development, the technology enables developers to observe what is happening within the “black box” while the system executes. As the technology collects information about the complete execution history, it is the basis for powerful tools as complements to usual “point-in-time” debuggers.

In the production environment the technology can be helpful to reduce the typically cost-intensive procedure of finding out why a system fails in the production environment on the customer’s site even if the system behaves correctly in the test environment on the developers’ site. With the technology, customers of the software create a trace when the system does not behave as expected. This trace is sent to the developers, which enables them to quickly find the origin for the misbehavior without extensive “problem communication” between customer and development or even having to travel to the customer’s site and debug the problem there.

Java Software Tracing Technology

Similar to C/C++ software tracing, Java software tracing enables developers and also end-users to capture the runtime behavior of a software system on code granularity. To inject event generating code into the Java system, aspect-orientation technology is exploited. When classes are loaded into the virtual machine, the classes’ byte code is augmented with event generating code. The Java software tracing technology can be used for analyzing desktop applications and applications running within a web/application server.

Web/application servers provide a runtime environment for Java components. For these systems, often the requirement exists that they should be kept operational without downtimes. Hence, when an incident occurs, such as the performance of the system goes down or a specific function of the system works not as expected, it is not possible to restart the system in “debug mode” and perform extensive runtime analysis of the system in the production environment. Instead, the developers need to reproduce the failure in the test environment --- typically without sufficient information on the internal processes of the system in the production environment, which results in large costs for such incidents.

With the Java software tracing technology, however, a trace is created that describes the internal system behavior on such a fine-granular way that developers can efficiently identify the reason for the unexpected behavior.

Multithreaded System Analysis Technology

This technology collects information about the runtime behavior of multithreaded software systems and visualizes that data to support developers in solving multithreading-related software engineering problems, e.g., related to debugging, performance analysis, or system understanding in general. For each thread, a trace is created that permits developers to precisely understand (a) what each thread executes and (b) how the threads interact.

Multithreaded software systems pose difficult problems to developers that do not exist in singlethreaded systems. Examples of these problems include race conditions and deadlocks. A key to solve multithreading-related programming problems is knowledge about the exact timing behavior of threads. State-of-the-art tools, such as debuggers, provide only little support in understanding the timing behavior because --- due to their heavy-weight approach --- they typically affect the timing too much. A common solution for developers to gain insight into system behavior is therefore to manually introduce console output code that informs the developer about the threads’ execution states. With this approach, however, developers obtain only punctual information about system behavior.

The multithreading systems analysis technology integrates runtime data collection in a light-weight way without manual intervention and, by this, provides automatically created views that show in high detail how threads execute and interact.

Distributed Systems Mining Technology

This technology enables the analysis and visualization of distributed software systems. It traces the internal behavior of the system's components and the messages exchanged among them. Automated trace analysis improves heuristic layout generation and provides additional information for the visualization.

Developers generally cannot cope with the inherent complexity of large distributed software systems. This technology aims to improve comprehension of the structure and behavior of these systems.

Object-Oriented Traces Mining Technology

OO-Trace Mining is a technology that analyzes the behavior in object-oriented system that arise from communication between object. OO Trace Mining collects data about object creation and destruction and monitors the inter- and intra-object communication. This object-related data is analyzed, mined, and visualized afterwards to support developers in understanding the runtime behavior of the OO system.

Before a developer of an object-oriented software system can change any code line, e.g., when fixing a bug or when implementing a system feature, the developer needs to understand deeply the objects’ lifetimes and their communication patterns occurring at runtime. Furthermore, the developer needs to understand the state transitions of an object during its lifetime. OO Trace Mining helps developers to speed up gathering an understanding of the objects’ runtime characteristics. It reveals outlier behavior of particular objects and automatically creates models describing the objects’ state changes.


  • teaser_01.PNG
    Hybrid-Treemap Layouting. Hahn, Sebastian; Döllner, Jürgen (2017).
  • rdc.png
    Relative Direction Change: A Topology-based Metric for Layout Stability in Treemaps. Hahn, Sebastian; Bethge, Joseph; Döllner, Jürgen (2017).
  • 2017-importance-based-aggregation.png
    Reducing Visual Complexity in Software Maps using Importance-based Aggregation of Nodes. Limberger, Daniel; Scheibel, Willy; Hahn, Sebastian; Döllner, Jürgen in Proceedings of the 8th International Conference on Information Visualization Theory and Applications (2017).
  • asemmo-thesis_compressed.pdf
    Design and Implementation of Non-Photorealistic Rendering Techniques for 3D Geospatial Data. Technical Report (PhD dissertation), Semmo, Amir (2016).
  • mtrapp_grapp2015_teaser.png
    Interactive Rendering and Stylization of Transportation Networks Using Distance Fields. Trapp, Matthias; Semmo, Amir; Döllner, Jürgen (2015). 207-219.
  • npg-22-545-2015_final.pdf
    Review: visual analytics of climate networks. Nocke, Thomas; Buschmann, Stefan; Donges, Jonathan; Marwan, Norbert; Schulz, Hans-Jörg; Tominski, Christian in Nonlinear Processes in Geophysics (2015). 22(5) 545-570.
  • tvc2015_draft.pdf
    Animated visualization of spatial-temporal trajectory data for air-traffic analysis. Buschmann, Stefan; Trapp, Matthias; Döllner, Jürgen in The Visual Computer (2015). 32(3) 371-381.
  • wtld_teaser.jpg
    Natural Phenomena as Metaphors for Visualization of Trend Data in Interactive Software Maps. Würfel, Hannes; Trapp, Matthias; Limberger, Daniel; Döllner, Jürgen (2015).
  • teaser-modified.png
    ThreadCity: Combined Visualization of Structure and Activity for the Exploration of Multi-threaded Software Systems. Hahn, Sebastian; Trapp, Matthias; Wuttke, Nikolai; Döllner, Jürgen (2015).
  • Visualization_of_Varying_Hierarchies_by_Stable_Layout_of_Voronoi_Treemaps.pdf
    Visualization of Varying Hierarchies by Stable Layout of Voronoi Treemaps. Hahn, Sebastian; Trümper, Jonas; Moritz, Dominik; Döllner, Jürgen (2014). 50-58.
  • PTD2013.pdf
    Multi-Perspective Detail+Overview Visualization for 3D Building Exploration. Pasewaldt, Sebastian; Trapp, Matthias; Döllner, Jürgen S. Czanner, Tang, W. (reds.) (2013). 57--64.
  • TreeMap.pdf
    Interactive Rendering of Complex 3D-Treemaps. Trapp, Matthias; Hahn, Sebastian; Döllner, Jürgen S. Coquillart, Andujar, C., Laramee, R. S., Kerren, A., Braz, J. (reds.) (2013). 165-175.
  • app-javascript.png
    SyncTrace: Visual Thread-Interplay Analysis. Karran, Benjamin; Trümper, Jonas; Döllner, Jürgen (2013). 10.
  • web_treemaps_teaser.png
    Interactive Software Maps for Web-Based Source Code Analysis. Limberger, Daniel; Wasty, Benjamin; Trümper, Jonas; Döllner, Jürgen (2013). 8.
  • tracediff_teaser.png
    Multiscale Visual Comparison of Execution Traces. Trümper, Jonas; Döllner, Jürgen; Telea, Alexandru (2013). 53-62.
  • usecase_TL_callstackdepth.png
    ViewFusion: Correlating Structure and Activity Views for Execution Traces. Trümper, Jonas; Telea, Alexandru; Döllner, Jürgen (2012). 45-52.
  • figure2_01.png
    Immersive Visualization of Virtual 3D City Models and its Applications in E-Planning. Engel, Juri; Döllner, Jürgen in International Journal of E-Planning Research (IJEPR) (2012). 1(4) 17-34.
  • EPTD12_draft.pdf
    An Immersive Visualization System for Virtual 3D City Models. Engel, Juri; Pasewaldt, Sebastian; Trapp, Matthias; Döllner, Jürgen (2012).
  • tasks_and_results.png
    A Service-Based Concept for Camera Control in 3D Geovirtual Environments. Klimke, Jan; Hagedorn, Benjamin; Döllner, Jürgen (2012).
  • SOMAP2012_v03.pdf
    A Service-Oriented Platform for Interactive 3D Web Mapping. Klimke, J.; Hagedorn, B.; Doellner, J. M. Jobst (red.) (2012). 127--139.
  • se_perspectives_01.png
    Extending Recommendation Systems with Software Maps. Trümper, Jonas; Döllner, Jürgen (2012). 92-96.
  • visualizing_trace_from_embedded_system.png
    Maintenance of Embedded Systems: Supporting Program Comprehension Using Dynamic Analysis. Trümper, Jonas; Voigt, Stefan; Döllner, Jürgen (2012). 58-64.
  • figure1_01.png
    Immersive Visualisierung von virtuellen 3D-Stadtmodellen und ihr Einsatz in der Stadtplanung. Engel, Juri; Döllner, Jürgen (2012). (Vol. 21) 165-172.
  • blender_overview.png
    A Visual Analysis Approach to Support Perfective Software Maintenance. Trümper, Jonas; Beck, Martin; Döllner, Jürgen (2012). 308-315.
  • sd_dragging_01.png
    A Visual Analysis and Design Tool for Planning Software Reengineerings. Beck, Martin; Trümper, Jonas; Döllner, Jürgen (2011). 54-61.
  • callneighborhood03.png
    Visualization of Execution Traces and its Application to Software Maintenance. Technical Report (PhD dissertation), Bohnet, Johannes (2011).
  • jtruemper_softvis2010_preprint.pdf
    Understanding Complex Multithreaded Software Systems by Using Trace Visualization. Trümper, Jonas; Bohnet, Johannes; Döllner, Jürgen (2010). 133-142.
  • jtruemper_quatic2010_preprint.pdf
    Visualization of Multithreaded Behavior to Facilitate Maintenance of Complex Software Systems. Trümper, Jonas; Bohnet, Johannes; Voigt, Stefan; Döllner, Jürgen (2010). 325-330.
  • ServerModeFindings.png
    Communication of Digital Cultural Heritage in Public Spaces by the Example of Roman Cologne. Trapp, Matthias; Semmo, Amir; Pokorski, Rafael; Herrmann, Claus-Daniel; Döllner, Jürgen; Eichhorn, Michael; Heinzelmann, Michael in Lecture Notes in Computer Science (LNCS), M. Ioannides (red.) (2010). 262-276.
  • Report.pdf
    Towards Efficient Camera Interaction in Service-based 3D Geovirtual Environments. Klimke, J. (2010). 211--219.
  • 5_convex_hull_based.jpg
    Techniques for Generalizing Building Geometry of Complex Virtual 3D City Models. Glander, Tassilo; Döllner, Jürgen in Lecture Notes in Geoinformation and Cartography, P. van Oosterom, Zlatanova, S., Penninga, F., Fendel, E. M. (reds.) (2008). 381--400.
  • Teaser3.jpg
    Interactive Multi-Perspective Views of Virtual 3D Landscape and City Models. Lorenz, Haik; Trapp, Matthias; Jobst, Markus; Döllner, Jürgen in Lecture Notes in Geoinformation and Cartography, L. Bernard, Friis-Christensen, A., Pundt, H. (reds.) (2008). 301--321.
  • hullc.jpg
    Seamless Integration of Labels into Interactive Virtual 3D Environments Using Parameterized Hulls. Maass, Stefan; Döllner, Jürgen P. Brown, Cunningham, D. W., Interrante, V., MacCormack, J. (reds.) (2008). 33--40.
  • hpi_tb23_bh.pdf
    Styling for Service-Based 3D Geovisualization. Hagedorn, Benjamin in Proceedings of the 2nd. Ph.D. retreat of the HPI Research School on Service-oriented Systems Engineering, C. Meinel (red.) (2008). 1:1-1:22.
  • hpi_tb18.pdf
    Proceedings of the Fall 2006 Workshop of the HPI Research School on Service-Oriented Systems Engineering Hagedorn, Benjamin; Schöbel, Michael; Uflacker, Matthias; Copaciu, Flavius; Milanovic, Nikola in Technische Berichte des Hasso-Plattner-Instituts für Softwaresystemtechnik an der Universität Potsdam (2007). (Vol. 18) Universitätsverlag Potsdam.
  • agile-d.jpg
    Depth Cue of Occlusion Information as Criterion for the Quality of Annotation Placement in Perspective Views. Maass, Stefan; Jobst, Markus; Döllner, Jürgen in Lecture Notes in Geoinformation and Cartography, S. I. Fabrikant, Wachowicz, M. (reds.) (2007). 473--486.
  • 3.jpg
    Analysis and Exploration of Virtual 3D-Citymodels using 3D Information Lenses. Trapp, Matthias (2007).
  • glander_doellner_generalization_posterPaper_final_draft.pdf
    Cell-Based Generalization of 3D Building Groups with Outlier Management. Glander, Tassilo; Döllner, Jürgen (2007).
  • 2_skyline_normal.png
    A Concept of Effective Landmark Depiction in Geovirtual 3D Environments by View-Dependent Deformation. Glander, Tassilo; Trapp, Matthias; Döllner, Jürgen (2007).
  • img02.jpg
    Chaining Geoinformation Services for the Visualization and Annotation of 3D Geovirtual Environments. Hagedorn, Benjamin; Maass, Stefan; Döllner, Jürgen (2007).
  • 3-smartgraphics06.jpg
    Efficient View Management for Dynamic Annotation Placement in Virtual Landscapes. Maass, Stefan; Döllner, Jürgen in Lecture Notes in Computer Science, A. Butz, Fischer, B., Krüger, A., Oliver, P. (reds.) (2006). (Vol. 4073) 1--12.
  • corp_doellner_thumbnail.jpg
    Virtual 3D City Models as Foundation of Complex Urban Information Spaces. Döllner, Jürgen; Baumann, Konstantin; Buchholz, Henrik M. Schrenk (red.) (2006). 107--112.
  • thumbnail.jpg
    Real-Time Visualization of 3D City Models. Technical Report (PhD dissertation), Buchholz,; Henrik, (2006).
  • 03_plan_view_top.png
    Real-Time Non-Photorealistic Rendering Techniques for Illustrating 3D Scenes and their Dynamics. Technical Report (PhD dissertation), Nienhaus,; Marc, (2006).
  • 2006-maass-wscg.pdf
    Dynamic Annotation of Interactive Environments using Object-Integrated Billboards. Maass, Stefan; Döllner, Jürgen J. Jorge, Skala, V. (reds.) (2006). 327--334.
  • hpi_tb06.pdf
    Konzepte der Softwarevisualisierung für komplexe, objektorientierte Softwaresysteme. Technical Report (6), Bohnet, Johannes; Brinkmann, Daniel; Döllner, Jürgen; Gierak, Alexander; Hagedorn, Benjamin; Lazic, Nebojsa; Schöbel, Michael (J. Bohnet; Döllner, J., reds.) (2005).
  • hpi_tb06.pdf
    Landschafts- und Stadtmetaphern zur Softwarevisualisierung. Hagedorn, Benjamin in Konzepte der Softwarevisualisierung für komplexe, objektorientierte Softwaresysteme, J. Bohnet, Döllner, J. (reds.) (2005). 59--72.
  • hpi_tb06.pdf
    CodeCrawler in der Anwendung. Hagedorn, Benjamin in Konzepte der Softwarevisualisierung für komplexe, objektorientierte Softwaresysteme, J. Bohnet, Döllner, J. (reds.) (2005). 39--46.
  • hpi_tb06_jb_jd.pdf
    Grundlagen der Softwarevisualisierung. Bohnet, Johannes; Döllner, Jürgen in Konzepte der Softwarevisualisierung für komplexe, objektorientierte Softwaresysteme, J. Bohnet, Döllner, J. (reds.) (2005). 1--7.
  • thumbnail_01.jpg
    Smart and Physically-Based Navigation in 3D Geovirtual Environments. Buchholz, Henrik; Bohnet, Johannes; Döllner, Jürgen (2005). 629--635.
  • 01-tc2005.jpg
    An Approach towards Semantics-Based Navigation in 3D City Models on Mobile Devices. Döllner, Jürgen; Hagedorn, Benjamin; Schmidt, Steffen in Schriftenreihe der Studienrichtung Vermessungswesen und Geoinformation an der TU Wien, G. Gartner (red.) (2005). 171--176.
  • thumbnail_02.jpg
    Smart Navigation Strategies for Virtual Landscapes. Buchholz, Henrik; Bohnet, Johannes; Döllner, Jürgen E. Buhmann, Paar, P., Bishop, I. D., Lange, E. (reds.) (2005). 124--131.
  • NprPaperVDM_stamped.pdf
    Real-Time Non-Photorealistic Rendering of 3D City Models. Buchholz, Henrik; Döllner, Jürgen; Nienhaus, Marc; Kirsch, Florian G. Gröger, Kolbe, T. H. (reds.) (2005).
  • 01_virtual_landscape.jpg
    Real-Time Virtual Landscapes in Landscape and Urban Planning. Döllner, Jürgen; Baumann, Konstantin; Buchholz, Henrik; Paar, Philip (2005).
  • thumbnail_07.jpg
    Visual Data Mining in Large-Scale 3D City Models. Buchholz, Henrik; Döllner, Jürgen (2005).
  • thumbnail_05.jpg
    Illustrative Visualization of 3D City Models. Döllner, Jürgen; Buchholz, Henrik; Nienhaus, Marc; Kirsch, Florian in Proceedings of the SPIE, R. F. Erbacher, Roberts, J. Cand G., Börner, K. (reds.) (2005). (Vol. 5669) 42--51.
  • thumb_06.jpg
    Constraints as Means of Controlling Usage of Geovirtual Environments. Döllner,; Jürgen, in Journal of Cartography and Geographic Information Science (2005). 32(2) 69--80.
  • genericRenderingSystem2.png
    A Generic Rendering System. Döllner, Jürgen; Hinrichs, Klaus in IEEE Transactions on Visualization and Computer Graphics (2002). 8(2) 99--118.
  • landUseTextures.png
    Software-Architektur computergrafischer Systeme Döllner, Jürgen (2001). Westfälische Wilhelms-Universität Münster.