Building Interactive Devices (Wintersemester 2023/2024)

Dozent: Prof. Dr. Patrick Baudisch (Human-Computer Interaction)

Allgemeine Information

• Semesterwochenstunden: 4
• ECTS: 6
• Benotet: Ja
• Einschreibefrist: 01.10.2023 - 31.10.2023
• Prüfungszeitpunkt §9 (4) BAMA-O: 24.11.2023
• Lehrform: Vorlesung
• Belegungsart: Wahlpflichtmodul
• Lehrsprache: Deutsch

Studiengänge, Modulgruppen & Module

Beschreibung

This hands-on class teaches two most recent evolution steps in interactive technologies: (1) interaction in 3D space, tracked using depth cameras and (2) interaction with physical matter by means of 3D printers, laser cutters, and robotics. The class wil be held on site at H2.57/58, 2nd floor main building.

In teams of two, students are given a projector, a Kinect depth camera, a tripod, an Arduino electronic kit, motors and encodes, a haptic actuator, among other materials.

First half: 3D Interaction based on Computer Vision

1. (Software Install Day: Bring your own laptop)
2. Overview
3. Image Segmentation to make a touchpad
4. Machine Learning to recognize foot-drawn letters
5. Homography to make a touchscreen
6. Unity plus Kinect for gesture interaction
7. Depth sensing

Second Half: Material Interaction 

1. Statics and Springs
2. Arduino and Electronics
3. Control and Dynamics
4. Robotics, Actuation, Friction, and Mechanisms
5. Trusses
6. Very large and Very Small Actuation
7. Robotics Competition

The class is held in a single 3h block each week. Most of the class uses a "studio class" format, i.e., extended periods where participants construct prototypes in class while advised by lecturers and teaching assistants. Students write code in C++ using the computer vision toolkit OpenCV and the Kinect SDK to get depth and skeleton data. A large part of the implementation work will take place in class and participants are provided with skeleton code to bootstrap assignments.­­­­­­­­­­­

Building Interactive Devices" works with and without "Building Interactive Systems
Building Interactive Devices" is designed to complement our other undergrad class called "Building Interactive Systems"--yet both are independent of each other, so that you may take them in any order or just one of them. "Building Interactive Devices" provides fifteen blocks of individual techniques and assignments--the engineering foundation. "Building Interactive Systems" then puts it all together by picking a single software/hardware challenge and following through on it. If you think of our HCI undergrad curriculum as a tree, think of "Building Interactive Systems" as its root, while "Building Interactive Devices" forms the leaves.

Voraussetzungen

No prerequisites. An interest in building and coding is certainly beneficial.

Lern- und Lehrformen

In order to prepare, we are asking you for a few things:

Please set up the development environment using the guide  https://hpi.de/baudisch/dokuwiki/bid-ws2324/assignments/0-software-setup. In classes Image Segmentation, Machine Learning Gesture Interaction and Homography, you will be programming using Microsoft Kinect Framework. If you are using a computer running Microsoft Windows, you can run the code natively; if you are running macOS or Linux we will help you setup the required virtual environment.

Looking forward to seeing you in class,

Prof. Dr. Patrick Baudisch and Martin Taraz

Leistungserfassung

We usually conduct a 90 min midterm exam (40% of the grade) and a 90 min final exam (60% of the grade).

Termine

The class will be held on-site, Friday 9:15 - 12:30 at H.2-57/58.

Class contents involving tool use (such as the laser cutter and 3D printers) will take place in the "HCI Workshop" (die Werkstatt, aka "the shop" aka H-2.45) in the main building on the second floor.

Zurück