Verarbeitungstechniken für visuelle Medien (Sommersemester 2020)

Lecturer: Dr. Matthias Trapp (Computergrafische Systeme) , Max Reimann (Computergrafische Systeme) , Sumit Shekhar (Computergrafische Systeme) , Sebastian Pasewaldt (Computergrafische Systeme)

General Information

• Weekly Hours: 4
• Credits: 6
• Graded: yes
• Enrolment Deadline: 06.04.2020 - 22.04.2020
• Teaching Form: Seminar / Project
• Enrolment Type: Compulsory Elective Module
• Course Language: German

Programs, Module Groups & Modules

Description

This project seminar aims at students who want to extend their image processing, computer vision, and computer graphics skills regarding the analysis, planning, and development of GPU-accelerated image and video processing techniques for mobile, desktop, and service-based systems. The course has mainly a project character and is subdivided into two parts:

The first part of the course is organized as a lecture series. The lecture topics are specified together with the seminar students and can include an introduction to the following basic concepts and foundations to:

• Fundamentals of image and video analytics,
• Techniques for image and video processing,
• Application prototyping for mobile, desktop, and service-based systems

Using specific image and video processing operations, the course teaches how fundamental processing techniques can be designed, developed, and tested.

In the second part of the course, participants will work individually, or as a team, to implement assigned topics in the field of interactive image and video processing. For all target systems, we offer middleware for development, which can be used. For example, a C++ Framework for Desktop applications, an Android and iOS framework for mobile applications, and JS (Angular, Node framework) for service-based browser-applications will be provided. Topics for this project seminar cover the following domains (not limited to):

• Convolutional Neural Networks for image analysis and transformation*.
• Image and video processing for VR (Virtual Reality) and AR (Augmented Reality) applications.
• Web-based image processing using WebGPU or WebGL
• Integration of interactive rendering techniques in 3rd party applications (e.g., Photoshop plugin).
• Implementation of interactive image stylization and editing tools for desktop systems.
• Service-based image and video-processing*
• Automated video summarization approaches to efficiently and effectively shorten videos*.
• Web-app development for service-based image- and video processing
• Integration of deep learning frameworks into visual computing pipelines for videos
• Implementing effects for visual media abstraction*

Topics marked by a * are related to a joint research project of the Hasso Plattner Institute with Digital Masterpieces and the German Federal Ministry of Education, which investigates new concepts and techniques for multidimensional video processing and automatic video abstraction.

Here you see an example result of last years seminar: https://youtu.be/z78u4YqVNsI

Requirements

• Successful completion of the lectures Computer Graphics I and/or II
• Basic knowledge of OpenGL and OpenGL ES Shading Language (GLSL) for image and video processing topics
• Basic knowledge/understanding of Neural Networks and/or Computer-Vision algorithms for image and video analysis topics
• For Service/Web-Apps development:
  • Basic knowledge/understanding of Angular, Node.js, Java-Script or Docker
  • Basic knowledge of Web-App development
• For Android mobile development:
  • Basic knowledge of Java programming language
  • An Android Device supporting OpenGL ES 3.0 or higher
• For iOS development:
  • Basic knowledge of Swift and Metal development
  • A Mac or MacBook, as well as an iOS device (a limited number of devices is available for the students)
• For Desktop development:
  • Basic knowledge of C++ development         
  • Familiarity with Qt Lib

Literature

Selected, topic-specific literature will be provided to the students throughout the seminar.

Learning

Project seminar (4 SWS/6 ECTS)

Examination

The final grade will be determined as follows:

• 50% Documented source code & prototypical application
• 15% Concept presentation (approx. 10 minutes)
• 25% Final presentation (approx. 25 minutes)
• 10 % Projectmanagement

Dates

The kick-off meeting as well as the lecture sessions are implemented virtually via Zoom.us.

Please note:
Please note that the enrolment deadline for the seminar is Wednesday, 22.04.2020. If you decide to official enroll for the seminar after choosing your topic at the end of the month, we will most likely find a pragmatic solution.

The official seminar kick-off will take place as follows:

• Date: Wednesday, 29.04.2020, 13:30-15:00
• Join URL: https://zoom.us/j/793561240?pwd=aCt6WDJzRmh4cHNBZzJHT2pPUVZ3QT09

The rest of the seminar is organized as follows: 

• The lectures will take place in the first 4 weeks (27.04. -22.05.2020)
• The project part will start in a self-organized way. Appointments with the supervisor are coordinated with the individual supervisors.
• The midterm presentation will take place in the week from 22.06.-26.06.2020.
• Based on student’s voting, the final presentation will take place August/September 2020.

Please note: In order to participate in one of the zoom meetings, please register in the respective moodle lecture: https://moodle.hpi3d.de/course/view.php?id=135

Zurück