Data Sonification & Opportunities of Sound (Wintersemester 2020/2021)

Lecturer: Dr. Julia von Thienen

General Information

• Weekly Hours: 2
• Credits: 3
• Graded: yes
• Enrolment Deadline: 01.10.-20.11.2020
• Teaching Form: Seminar
• Enrolment Type: Compulsory Elective Module
• Course Language: English

Programs, Module Groups & Modules

Description

Hosts: This seminar is co-organized by Julia von Thienen, Marisol Jimenez and Henrik von Coler.

Location: The seminar is offered in person, HPI main building, room H E 51/52 (Hauptgebäude, Erdgeschoss). There is also the possibility to take part virtually via Zoom.

If you want to take part online please visit:

uni-potsdam.zoom.us/j/68038908144

Meeting-ID: 680 3890 8144

Kenncode: 20202020

Time: The seminar takes place on Mondays, beginning Nov 2, 3:15 – 4:45 pm.

- - -

 

Content: While the human sense of vision is harnessed a lot in human-computer interactions, opportunities arising from other human senses are much less explored. This class is especially dedicated to the auditory sense and resulting design opportunities in the field of digital engineering. It provides basic knowledge, skills and experiences in two directions: (i) audio technology, tools for data sonification and multichannel audio; (ii) the use of creativity and artistic freedom in the exploration of sound-related design opportunities.

In technical terms, the course is especially concerned with data sonification, a novel avenue for Human Data Interaction (HDI) that complements data visualisation. The potential of data sonification has been demonstrated, for instance, in the area of digital health. Based on well-designed sonification algorithms, sonified EEG data allows medical novices to detect critical conditions in seizure patients with a higher degree of accuracy than trained personnel visually inspecting EEG plots.

The seminar offers an introduction to music informatics, covering languages and environments: C++, Supercollider, PD (Max/MSP), Faust, Python, MIR, Kyma. It discusses the periphery (open sound control, microcontroller, PI) and spatial sound. In terms of sound synthesis, you learn about taxonomies, obtain a brief historical overview, learn about implementations and algorithms. As sound synthesis approaches, this course covers additive and subtractive techniques, physical modelling, spectral modelling and abstract algorithms. Further technical topics include machine listening, noise, and binaural rendering techniques.

In artistic regards, you learn about the basics of sound art and composition, create your own sound installation and design your own sounds.

In theoretical terms, this course is anchored in design thinking by means of the key concept of “human needs.” In this class, we work in particular with a framework of human needs developed by design thinking pioneer Robert McKim, which pays special attention to the role of all human senses in creative design processes and resulting products. The course is also a part of HPI neurodesign education; key application interests concern neuroscientific and digital health data. 

A major part of the class is your own creative project. Based on personal interests and passions, you can self-design your own digital engineering project, in which you explore opportunities of sound. Creative projects can be pursued alone as well as in teams.

Requirements

There are no prerequisites for attending this class. 

To intensify your learnings, you can also take part in the “Neurodesign Lecture” on Mondays (11:00 a.m - 12:30 p.m.), but this is not obligatory.

It is possible to conduct one bigger project across the neurodesign lecture and the neurodesign data sonification seminar. 

Examination

The final grade will be determined as follows:

Your Project

• 20% first project presentation
• 20% final project presentation
• 30% documented source code & prototypical application (by March 31)

In-Class Topics & Skills

• 15% audio technology method competence & engagement in class
• 15% artistic & creative exploration in class

Dates

Dates (preliminary)

2.11.     Julia von Thienen: Design thinking concepts of human needs, multisensory HCI & HDI

              Marisol Jimenez: An Artist's Perspective on Sound Art

              Henrik von Coler: Technolgical Aspets of Electroaoustic Music and Sound Art

 9.11.     Henrik von Coler: Music Informatics (C++ / Supercollider / PD (Max/MSP) / Faust / Python / MIR)

16.11.    Lukas Hartman, Luca Hilbrich, Tim Strauch, Philipp Steigerwald: The history of data sonification, interesting works and workshopping your own applications

23.11.    Kaffe Matthews: Electroacoustic composition with space, data and things (via ZOOM)

30.11.    Marisol Jimenez: Deep listening, basics of composition and workshopping your own piece

 7.12.     Henrik von Coler: Sound synthesis (Taxonomy, History and Implementation)

14.12.    First project pitches and discussion of ideas

21.12.    Sonification: Recent project examples

4.1.        Noel Danz: Binaural renderings & brain data sonification with the BITalino platform

11.1.      Nicolas D’Aleman: Machine listening, theory of sound and space; audio rendering techniques for multichannel audio

18.1.      Marisol Jimenez: Creating your own sound installation live

25.1.     Nico Steckhan: Sonification and digital health

1.2.        Knut Kaulke: Sonification with Kyma

8.2.        Final presentation of in-class projects

Zurück