Building Interactive Devices (Wintersemester 2021/2022)

Dozent: Prof. Dr. Patrick Baudisch (Human-Computer Interaction)

Allgemeine Information

• Semesterwochenstunden: 4
• ECTS: 6
• Benotet: Ja
• Einschreibefrist: 01.10.2021 - 22.10.2021
• Lehrform: Vorlesung
• Belegungsart: Wahlpflichtmodul
• Lehrsprache: Deutsch

Studiengänge, Modulgruppen & Module

Beschreibung

This hands-on class teaches two most recent evolution steps in interactive technologies: (1) interaction in 3D space, tracked using depth cameras and (2) interaction with physical matter by means of 3D printers, laser cutters, and robotics. The class wil be held on zoom.

In teams of two, students are given a projector, a Kinect depth camera, a tripod, an Arduino electronic kit, motors and encodes, a haptic actuator, among other materials.

First half: 3D Interaction based on Computer Vision

1. (Software Install Day: Bring your own laptop)
2. Overview
3. Image Segmentation to make a touchpad
4. Machine Learning to recognize foot-drawn letters
5. Homography to make a touchscreen
6. Unity plus Kinect for gesture interaction
7. Depth sensing

Second Half: Material Interaction 

1. Statics, Trusses, and Springs
2. Arduino and Electronics
3. Control and Dynamics
4. Robotics, Actuation, Friction, and Mechanisms
5. Laser Cutting
6. Very large and Very Small Actuation
7. Robotics Competition

The class is held in a single 3h block each week. Most of the class uses a "studio class" format, i.e., extended periods where participants construct prototypes in class while advised by lecturers and teaching assistants. Students write code in C++ using the computer vision toolkit OpenCV and the Kinect SDK to get depth and skeleton data. A large part of the implementation work will take place in class and participants are provided with skeleton code to bootstrap assignments.­­­­­­­­­­­

Building Interactive Devices" works with and without "Building Interactive Systems
Building Interactive Devices" is designed to complement our other undergrad class called "Building Interactive Systems"--yet both are independent of each other, so that you may take them in any order or just one of them. "Building Interactive Devices" provides fifteen blocks of individual techniques and assignments--the engineering foundation. "Building Interactive Systems" then puts it all together by picking a single software/hardware challenge and following through on it. If you think of our HCI undergrad curriculum as a tree, think of "Building Interactive Systems" as its root, while "Building Interactive Devices" forms the leaves.

 

Voraussetzungen

No prerequisites. An interest in building and coding is certainly beneficial.

Lern- und Lehrformen

UPDATE OCT.12

The class will be held on-site, Friday 9:15 - 12:15 at H.2-57/58.

In order to prepare, we are asking you for a few things:

1. Please join BID2021 discord server. There will be TA ready for support during installation / setup and for weekly assignments. The link to the discord is on the class wiki.
2. Please join the development environment session on 29.10.2021 from https://hpi.de/baudisch/dokuwiki/bid-ws2022/assignments/0-software-setup. In classes Image Segmentation, Machine Learning Gesture Interaction and Homography, you will be programming using Microsoft Kinect Framework. If you are using a computer running Microsoft Windows, you can run the code natively; if you are running macOS or Linux we will help you setup the required virtual environment.

Looking forward to seeing you in class,

Prof. Dr. Patrick Baudisch and TAs Jotaro Shigeyama and Martin Taraz

Leistungserfassung

We usually conduct a 90 min midterm exam (40% of the grade) and a 90 min final exam (60% of the grade). Given the corona situation, we may or may not condense this into a single exam at the end.

Termine

The class will be held on-site, Friday 9:15 - 12:15 at H.2-57/58.

Class contents involving tool use (such as the laser cutter and 3D printers) will take place in the "HCI Workshop" (die Werkstatt, aka "the shop" aka H-2.45) in the main building on the second floor.

First day of class is "Software Install Day" on  29/10/2021 (Onsite at H.2-57/58).
This is 3 hours during which you and the teaching team will get your computer ready for class. 

Feel free to set up your machine alone or make use of our support, either by joining us in person or virtually over discord [links to come soon].
Software Setup Guide: https://hpi.de/baudisch/dokuwiki/bid-ws2022/assignments/0-software-setup

Official first day of lecture by Professor Baudisch on 5/11/2021 (TBD)

The intermediate exam will take place on 03.12.2021, 09:15.

The final exam will take place on 11.02.2022, 09:15 at H-2.57/58.

Zurück