Prof. Dr. Felix Naumann

Hazar Harmouch

Research Assistant , PhD Candidate

Infomation Systems Research Group 
Hasso-Plattner-Institut | Universität Potsdam
Prof.-Dr.-Helmert-Straße 2-3, D-14482 Potsdam

Contact Information

Research Interests

  • Web Tables similarity and Table joins
  • Data Profiling
  • Data Mining
  • Big Data




Data Anamnesis: Admitting Raw Data into an Organization

Kruse, Sebastian; Papenbrock, Thorsten; Harmouch, Hazar; Naumann, Felix in IEEE Data Engineering Bulletin 2016 .

Today’s internet offers a plethora of openly available datasets, bearing great potential for novel applications and research. Likewise, rich datasets slumber within organizations. However, all too often those datasets are available only as raw dumps and lack proper documentation or even a schema. Data anamnesis is the first step of any effort to work with such datasets: It determines fundamental properties regarding the datasets’ content, structure, and quality to assess their utility and to put them to use appropriately. Detecting such properties is a key concern of the research area of data profiling, which has developed several viable instruments, such as data type recognition and foreign key discovery. In this article, we perform an anamnesis of the MusicBrainz dataset, an openly available and com- plex discographic database. In particular, we employ data profiling methods to create data summaries and then further analyze those summaries to reverse-engineer the database schema, to understand the data semantics, and to point out tangible schema quality issues. We propose two bottom-up schema quality dimensions, namely conciseness and normality, that measure the fit of the schema with its data, in contrast to a top-down approach that compares a schema with its application requirements.
Data Anamnesis: Admitting... - Download
Further Information
Tags data_anamnesis  data_profiling  isg  profiling  schema_discovery