Hasso-Plattner-Institut25 Jahre HPI
Hasso-Plattner-Institut25 Jahre HPI

Building Interactive Systems (Sommersemester 2021)

Dozent: Prof. Dr. Patrick Baudisch (Human-Computer Interaction)

Allgemeine Information

  • Semesterwochenstunden: 4
  • ECTS: 6
  • Benotet: Ja
  • Einschreibefrist: 18.03.2021 - 09.04.2021
  • Lehrform: Vorlesung
  • Belegungsart: Wahlpflichtmodul
  • Lehrsprache: Deutsch
  • Maximale Teilnehmerzahl: 24

Studiengänge, Modulgruppen & Module

IT-Systems Engineering BA


The classes will take place via Zoom this semester. For detailed description about class and Zoom setup, please see  class wiki .

"Building Interactive Systems " works with and without "Building Interactive Devices "
"Building Interactive Systems" is designed to complement our other undergrad class called "Building Interactive Devices" - yet both are independent of each other, so that you may take them in any order or just one of them. While "Building Interactive Devices" provides fifteen blocks of individual techniques and assignments, "Building Interactive Systems" puts it all together by picking a single software / hardware challenge and following through on it. If you think of our HCI undergrad curriculum as a tree, think of "Building Interactive Systems" as its root, while "Building Interactive Devices" forms the leaves.

Objective:  The objective of this class is to teach you how to make successful interactive software systems.

Project:  to allow you to apply the material learned in class, you will create your own application program. To make this interesting and challenging, we picked an application scenario that you probably not familiar with: blind users.

Platform : an interactive device that allows blind users to draw and play. DualPanto allows blind users to go past the traditional iPhone +  voiceOver  screen reader, in that it allows blind users to interact with  spatial  contents, such as maps, drawing, or shooter games. if Corona permits, we will provide each team with the parts for one dualPanto devce so you can make your own device. 

Coding:  You will program in C # in Unity3D as an efficient means for prototyping, as well as actual coding. You will approach the topic in steps: a hello-world app, an audio-only app, a haptics-only app based on dualPanto, and then you will combine what you have learned into your very own integrated speech and haptics app. To make coding tractable, we will provide you with a custom API that allows you to handle speech input and output and to control your dualPanto device. Questions about the API? 

Creative process:  In parallel to building and coding, you will perform the logical steps necessary to make your software successful, ie, you will brainstorm, sketch, present, prototyping, critique, and evaluate each other's apps in a studio format.

Demo fest:  At the end of the semester, if Corona permits, there will be a demo-fest during which actual blind users will try out your applications.

Outlook: making a product:  To round your project off, we will ask: what does it take to make an idea into a product in 2020? We think of this from a historical perspective: people wrote application programs in the 80's, web pages in the 90's, and phone apps in the 2000's. Today, the advent of cheap manufacturing in Shenzhen combined with crowdfunding platforms, such as Kickstarter, enables people to create software / hardware systems, such as the pebble watch or robot arms. We think this through with you by looking at how to get not only software, but also electronics and hardware ready for manufacturing.


Participants have to be able to (and be willing to) share their video using Zoom in order to effectively participate in this class. This lecture is taught in English.


There will be a 60 min final exam. In order to be admitted to the exams, participants need to successfully complete homework assignments. Students will solve problems in teams of two, implement a series of prototypes, and present their work in class.


Lectures take place on Friday from 09:15 to 12:30 via zoom*, this includes time to work on the assignments we give out each week.

Before the lecture starts, please check out our dokuwiki with all logistics and information on how to get going for the class. Follow the set-up guide to get your system up to speed for this. 

*You will receive the lecture password once you signed up on the mailing list