Semantic Technologies

In recent years the Semantic Web has emerged as one of the most essential achievements for the future of the World Wide Web (WWW). Semantic Web technology extends the WWW but also enables to improve applications which are related to other fields such as communication, information, knowledge, media, and interaction technologies. Semantic Web provides not just new technologies and tools but also new paradigms and ways of thinking, to make information processing more efficient and more structured.

Our research is focussed on the devolpment and improvement of 'semantically supported multimedia retrieval and search technologies'.

Table of Contents

  • Current News
  • Prior Events and Activities
  • Research Topics
  • Research Team
  • Former Team Members
  • Teaching
  • Supervised Master Theses
  • Projects and Partners
  • In the Media
  • Recent Publications

Research Topics

  • (1) Semantic Multimedia
  • (2) Linked Data Engineering and Applications
  • (3) Semantically enhanced Information Retrieval (Semantic Search)
  • (4) Knowledge Mining and Ontological Engineering
  • (5) Semantically enriched e-Learning Applications

Job Offers

Research Team

Former Team Members

  • Dr. Olaf Hartig (PostDoc)
  • Dinesh Reddy, M.Sc.
  • Tamara Bobic, M.Sc.
  • Dipl.-Inf. Katarina Birghan
  • Bernhard Quehl, M.Sc.
  • Dr. Nadine Steinmetz
  • Dr. Haojin Yang
  • Dipl.-Inf. Lina Wolf
  • Dipl.-Dokumentar Johannes Hercher
  • Joscha Jäger, M.A. (internship)
  • Johannes Osterhoff, M.A.
  • Dipl.-Inf. Zalan Kramer

Our group

Left to Right: Nadine Steinmetz, Johannes Osterhoff, Dr. Harald Sack, Jörg Waitelonis, Christian Hentschel, Bernhard Quehl

Publications

CONTENTUS - technologies for next generation multimedia libraries

Nandzik, Jan; Litz, Berenike; Flores-Herr, Nicolas; Löhden, Aenne; Konya, Iuliu; Baum, Doris; Bergholz, André; Schönfuß, Dirk; Fey, Christian; Osterhoff, Johannes; Waitelonis, Jörg; Sack, Harald; Köhler, Ralf; Ndjiki-Nya, Patrick in Multimedia Tools and Applications 2013 .

An ever-growing amount of digitized content urges libraries and archives to integrate new media types from a large number of origins such as publishers, record labels and film archives, into their existing collections. This is a challenging task, since the multimedia content itself as well as the associated metadata is inherently heterogeneous—the different sources lead to different data structures, data quality and trustworthiness. This paper presents the contentus approach towards an automated media processing chain for cultural heritage organizations and content holders. Our workflow allows for unattended processing from media ingest to availability thorough our search and retrieval interface. We aim to provide a set of tools for the processing of digitized print media, audio/visual, speech and musical recordings. Media specific functionalities include quality control for digitization of still image and audio/visual media and restoration of the most common quality issues encountered with these media. Furthermore, the contentus tools include modules for content analysis like segmentation of printed, audio and audio/visual media, optical character recognition (OCR), speech-to-text transcription, speaker recognition and the extraction of musical features from audio recordings, all aimed at a textual representation of information inherent within the media assets. Once the information is extracted and transcribed in textual form, media independent processing modules offer extraction and disambiguation of named entities and text classification. All contentus modules are designed to be flexibly recombined within a scalable workflow environment using cloud computing techniques. In the next step analyzed media assets can be retrieved and consumed through a search interface using all available metadata. The search engine combines Semantic Web technologies for representing relations between the media and entities such as persons, locations and organizations with a full-text approach for searching within transcribed information gathered through the preceding processing steps. The contentus unified search interface integrates text, images, audio and audio/visual content. Queries can be narrowed and expanded in an exploratory manner, search results can be refined by disambiguating entities and topics. Further, semantic relationships become not only apparent, but can also be navigated.
Nandzig2012.pdf
Further Information
Tags its

Projects and Partners

 

  • AV-Portal Gottfried-Leibnitz-Universität Hannover, project with Technische Informationsbibliothek Hannover (TIB)
  • Semantic Media Explorer (SEMEX)
    The Semantic Media Explorer is a demonstrator that combines the latest media analysis processes to provides optimal access to video content.
  • MEDIAGLOBE Project
    The aim of MEDIAGLOBE is to open and interlink heterogenouse and currently isolated information sources in media archives and broadcasting corporation. Project partners: DEFA-spektrum, Medienbildungsgesellschaft Babelsberg mbH, Blue Order GmbH
  • THESEUS/CONTENTUS Project
    The purpose of CONTENTUS is to develop basic technologies with which to access, archive and search for multi-media cultural assets and works of art.
  • YOVISTO
    Yovisto is a video search engine specialized in academic content. Yovisto's search index is based on the combination of automated content based video analysis with user generated collaborative annotation (collaborative tagging, discussions, and comments). In difference to traditional video search engines, Yovisto enables pinpoint access within video data by providing fine-granular, time-dependent metadata.
  • Semantic Games
    Games with a purpose that are dedicated to create and curate semantic content.

Current News

Prior Events and Activities

 

2011

2010

2009

Teaching

 

 

&nb

2014 (SS)

2013/14 (WS)

2013 (SS)

  • Seminar (Master): Semantic Multimedia (Blog)
  • Seminar (Bachelor): Multimedia Analyse Technologien (Blog)
  • Schülerkolleg (für Schüler der 8. bis 10. Klasse): Internetsuche und Google PageRank - Wie wird was durch wen gefunden?

    • Woche 1 - 09.04.2013: Die Geschichte der Web-Suchmaschinen (pdf)
    • Woche 2 - 23.04.2013: Term- und Dokumentenranking (pdf)
    • Woche 3 - 07.05.2013: Google Page Rank (pdf)
    • Woche 4 - 21.05.2013: Personalisierung und Web Crawling (pdf)
    • Woche 5 - 04.06.2013: Semantische Suche

 

 

2012/13 (WS)

2012 (SS)

2011/12 (WS)

2011 (SS)

2010/11 (WS)

2010 (SS)

2009/10 (WS)

 

 

&nb

Supervised Master Theses

  • Gerald Töpper: Erweiterung der DBpedia Ontologie und des Extraction Frameworks zur Sicherung der Datenqualität. (finished April 2012)
  • Peter Retzlaff: Visualisierung von Bag-of-Visual-Words-Vektoren für die Visual Concept Detection (finished March 2014)
  • Sebastian Stange: Evaluierung einer semantischen Videosuche und Ermittlung geeigneter Videoanalysetechniken (finished March 2014)
  • Michael Wolowyk: Semantic Recommender Systems (preliminary title) (in progress)

Open Master Theses

Please find a list of possible topics for Master Theses. Contact us, if you are interested in one of these topics or have own suggestions.

  • Video Analysis:

    • OCR Spellcorrection
    • Tag Relevance Estimation in Photo Communities
    • Learning Local Image Descriptors

  • Linked Data and Semantic Web:

    • Named Entity Evolution
    • Authority File Mapping
    • A Mereology for Media Fragments

 

 

 

Press

 

Other Links

... to our Research
              Security Engineering - Learning & Knowledge Tech - Design Thinking - former
... to our Teaching
              Tele-Lectures - MOOCs - Labs - Systems 
... to our Publications
              Books - Journals - Conference-Papers - Patents
... and to our Annual Reports.