Hasso-Plattner-Institut
Prof. Dr. Felix Naumann
  
 

Data Preparation for Science

Lecture: Prof. Dr. Felix Naumann & Lan Jiang

The Lecture is taking place once a week at Campus II

Description

Data preparation is the process of transforming data before serving them to downstream tasks, such as data analytics, data cleaning, and machine learning. Conducting experiments on data from various sources, and reproducing results of previous experiments are two tasks that data scientists frequently perform. However, much data do not meet the requirements of experiments, leading scientists to spend a lot time on data preparation. It is reported that preparing data is both labor-intensive and tedious work, which accounts for 50%-80% of the time spent for the whole data lifecycle.

In this seminar, students will learn about common data preparation methods used in scientific work. Following some introductive presentations in the beginning of the seminar, students will learn the difficulty of scientific data preparation by trying to repeat experiments. They will investigate about what contributes to an efficient and robust data preparation method for scientific tasks. Students will try to extend the data preparation system by integrating their proposals of more advanced preparation tasks.

Students will work in small groups or on their own on the following fields:

·       Repeat experiments from existing literature.

·       Form an investigative report about what components may contribute to better scientific data preparation.

·       Extend a data preparation system by implementing one component (e.g., data provenance, preparation optimization, preparation suggestion, error handling)

Schedule

The Lecure is taking place Tuesdays at 1:15 PM in the Seminar Room F.E.06 at Campus II, Building F

Date Subject Material
16.10. Introduction 01_slides
23.10. Use-case oriented data preparation on address data          02_slidestask-proposals
30.10. Meeting to talk about progress 03_slides
06.11. Presentation on assignment 1  
13.11.

Introduction about more advanced data preparation techniques

Introduce assignment 2 (Moved to G3.E.15/16 at Campus III)

05_slides
20.11. Meeting for discussion on progress  
27.11. Meeting for discussion on progress  
04.12. Presentation on assignment 2  
11.12. Introduce and discuss the preferred grand task 06_slides
18.12. Related work on data preparation 07_slides
  Christmas holidays  
08.01. Meeting for discussion on progress  
15.01. Informal intermediate presentation of your progress.  
22.01. Literature presentations  
29.01. Guest lecture by Prof. Dr. Ziawasch Abedjan
"Data cleaning in the Wild"
 
05.02. Final presentation on the grand task.  

 

 

Literatur