Hasso-Plattner-InstitutSDG am HPI
Hasso-Plattner-InstitutDSG am HPI
Login
 

Approximate Data Profiling (Wintersemester 2022/2023)

Lecturer: Prof. Dr. Felix Naumann (Information Systems) , Tobias Bleifuß (Information Systems) , Youri Kaminsky
Course Website: https://hpi.de/en/naumann/teaching/current-courses/ws-22-23/approximate-data-profiling.html

General Information

  • Weekly Hours: 4
  • Credits: 6
  • Graded: yes
  • Enrolment Deadline: 01.10.2022 - 30.10.2022
  • Examination time §9 (4) BAMA-O: 08.12.2022
  • Teaching Form: Project seminar
  • Enrolment Type: Compulsory Elective Module
  • Course Language: English
  • Maximum number of participants: 6

Programs, Module Groups & Modules

IT-Systems Engineering MA
Data Engineering MA
Software Systems Engineering MA
  • DSYS: Data-Driven Systems
    • HPI-DSYS-C Concepts and Methods
  • DSYS: Data-Driven Systems
    • HPI-DSYS-T Technologies and Tools
  • DSYS: Data-Driven Systems
    • HPI-DSYS-S Specialization

Description

Data profiling is the process of extracting metadata from datasets. One important aspect is the discovery of data dependencies, such as Functional Dependencies (FDs), Inclusion Dependencies (INDs) and Unique Column Combinations (UCCs). However, the increasing size of datasets presents a challenge to traditional approaches of data profiling. Therefore, this seminar focuses on sampling-based methods for approximate data profiling.

First, the students become familiar with related work as an inspiration. Afterwards, each student team develops own ideas. These can concern both the sampling process itself or the actual discovery in the sample.

The students turn their ideas into working algorithms. There are two main goals for each algorithm:
1) Find a set of dependencies that is close to the actual solution.
2) Minimize the required runtime.
Benchmark Datasets are provided to the students.
Finally, the students present their approaches and write a short report.

Literature

Learning

Project seminar with weekly meetings, talks, discussions and report writing

Examination

Presentation and report

Dates

See webpage.

Zurück