Mining streaming data (Sommersemester 2019)

Lecturer: Prof. Dr. Felix Naumann (Information Systems) , Dr. Thorsten Papenbrock (Information Systems) , Dr. Alexander Albrecht (Information Systems)
Course Website: https://hpi.de/en/naumann/teaching/teaching/ss-19/mining-streaming-data.html

General Information

• Weekly Hours: 4
• Credits: 6
• Graded: yes
• Enrolment Deadline: 26.04.2019
• Teaching Form: Lecture / Seminar
• Enrolment Type: Compulsory Elective Module
• Course Language: English
• Maximum number of participants: 8

Programs, Module Groups & Modules

Description

In many big data scenarios, data comes with high speed as a never-ending stream of
events. For these data streams, decisions need to be made often on the fly.
Unfortunately, common algorithms are rarely applicable in scenarios with streaming data.
Most algorithms were designed for offline settings, i.e., the entire data set needs to be
scanned and processed (multiple times), before a decision can be made.
Therefore, novel algorithms on data streams are needed: In this seminar, we implement,
evaluate (and at best improve) streaming algorithms from current research projects. We will
look at data stream mining, recommendations for data streams, and algorithms for graph
streams where edges and vertices arrive in a streaming fashion.
Students will develop data streaming techniques and implement prototypes based on current
research projects: Each team, consisting of two students, chooses and presents a
challenging research task and implements the proposed solution using the streaming
framework Apache Kafka with Kafka Streams .
Students may select one of the papers listed here. This is a first selection of current research
about data streams (tbc). We welcome further suggestions.
● Chaitanya Manapragada, Geoffrey I. Webb, and Mahsa Salehi, Extremely Fast
Decision Tree , KDD 2018.
See also github.com/chaitanya-m/kdd2018.git
● Kai Sheng Tai, Vatsal Sharan, Peter Bailis, and Gregory Valiant, Sketching Linear
Classifiers over Data Streams , SIGMOD 2018.
See also github.com/stanford-futuredata/wmsketch
● Yang Zhou, Tong Yang, Jie Jiang, Bin Cui, Minlan Yu, Xiaoming Li, and Steve Uhlig,
Cold Filter: A Meta-Framework for Faster and More Accurate Stream Processing ,
SIGMOD 2018.
See also github.com/streamclassifier/ColdFilter
● Aneesh Sharma, Jerry Jiang, Praveen Bommannavar, Brian Larso, and Jimmy Lin,
GraphJet: Real-Time Content Recommendations at Twitter , VLDB 2016.
See also github.com/twitter/GraphJet
● Xiangmin Zhou, Dong Qin, Xiaolu Lu, Lei Chen, and Yanchun Zhang, Online Social
Media Recommendation over Streams , ICDE 2019.
● Dhivya Eswaran, Christos Faloutsos, Sudipto Guha, and Nina Mishra, SpotLight:
Detecting Anomalies in Streaming Graphs . KDD 2018.
This is a project seminar: There will be a few weekly lectures including an introductory
lecture and an invited talk from industry about Stream Processing with Apache Kafka.
Teams will frequently meet with the assigned supervisor.

Requirements

For this seminar, participants require the following prerequisites:

• Database knowledge (ideally Database System I and Database Systems II)
• Data streaming and distributed programming knowledge (ideally Distributed Data Analytics or Distributed Data Management)

Examination

In teams, with team size is two students, you will be completing the following tasks:

• (10%) Active participation during all seminar events.
• (10%) Short presentation of the selected research paper.
• (15%) Intermediate presentation demonstrating insights regarding your research prototype.
• (00%) Regular meetings with advisor.
• (20%) Implementation of a research prototype with Kafka and Kafka Streams.
• (15%) Final presentation demonstrating your solution.
• (30%) Code & documentation (on GitHub). The documentation should contain information on how to execute and evaluate your solution. Furthermore, it should also show strengths and weaknesses of the implementation.

Dates

Siehe Webseite des Fachgebiets

Zurück