The amount of multimedia content on the World Wide Web is growing rapidly. Efficiently managing and organizing it requires new technologies. One example of such a technology is the semantic multimedia search. We use an automated processes for semantically analyzing audiovisual content and demonstrate how it is possible to access the ever-growing mass of information more efficiently.

Here you can find a screencast demonstrating a more tangible access on huge video archives as well as some background information about the utilized technologies. Relevant publications provided by our research team are given at the end of this page.


ERROR: Content Element with uid "124028" and type "media" has no rendering definition!

ERROR: Content Element with uid "123968" and type "media" has no rendering definition!

ERROR: Content Element with uid "120452" and type "media" has no rendering definition!



The Semantic Media Explorer combines the latest media analysis processes, such as automatic scene segmentation, intelligent character recognition, and the ability to recognize genres and faces in videos. As a result, it provides optimal access to video content. This new kind of multimedia search offers users enhanced support with semantically enhanced metadata and intuitive user interfaces. The information extracted via the media analysis is correlated using semantic information so that users can identify new links and “rummage around” in the multimedia content. In developing the Semantic Media Explorer, the HPI researchers are using highly efficient processes to process the huge volumes of data in the Future SOC Lab’s new high-performance computers.


Publications & Presentations

  • Invited Talk20.09.2012: Harald Sack "Der Weg ist das Ziel – Explorative semantische Suche" (IVDW2012) Braunschweig.
  • 20.09.2012: Jörg Waitelonis "Widen the Peepholes! Entity-based Auto-Suggestion as a rich and yet immediate Starting Point for Exploratory Search" (IVDW2012)Braunschweig.
  • Haojin Yang, Bernhard Quehl, Harald Sack, A skeleton based binarization approach for video text recognition, 13th International Workshop on Image analysis for multimedia interactive services (WIAMIS 2012), 23rd - 25th May 2012, IEEE Press, Dublin Ireland. [copy PDF] [poster] [citation BibTex]
  • C. Hentschel, J. Hercher, M. Knuth, J. Osterhoff, B. Quehl, H. Sack, N. Steinmetz, J. Waitelonis, H-J.Yang:
    Open Up Cultural Heritage in Video Archives with Mediaglobe, 12th International Conference on Innovative Internet Community Services (I2CS 2012), June 13-15, 2012, Trondheim (Norway) [copy PDF] [citation BibTex] (best paper award)
  • Haojin Yang, Bernhard Quehl and Harald Sack:
    Text detection in video images using adaptive edge detection and stroke width verification, 19th Int. Conf. on Systems, Signals and Image Processing (IWSSIP), IEEE Press, Vienna, Austria, April. 11-13, 2012  [copy PDF] [citation BibTex].
  • Haojin Yang, Maria Siebert, Patrick Lühne, Harald Sack, Christoph Meinel:
    Automatic Lecture Video Indexing Using Video OCR Technology, IEEE Int. Symposium on Multimedia 2011 (ISM 2011), IEEE Press, Dana Point, CA, USA, Dec. 5-7, 2011. [local copy PDF | citation BibTex]
  • Haojin Yang, Maria Siebert, Patrick Lühne, Harald Sack, Christoph Meinel:
    Lecture Video Indexing and Analysis Using Video OCR Technology, 7th Int. Conf. on Signal Image Technology and Internet Based Systems (SITIS 2011), Track Internet Based Computing and Systems, IEEE/ACM Press, Dijon (France), Nov. 28 - Dec. 1, 2011. [local copy PDF]
  • Invited talk: 30.09.2011: Harald Sack, "Enabling Exploratory Video Search by Semantic Video Analysis" at Learning, Knowledge, Adaptation (LWA) 2011, Magdeburg.
  • Invited talk: 01.09.2011: Jörg Waitelonis, "Inhaltsbasierte Erschließung und Suche in multimedialen Objekten" at  35. Jahrestagung der Gesellschaft für Klassifikation, Frankfurt.
  • Invited talk: 20.06.2011: Harald Sack, "Semantic Search for audiovisual media" at THESEUS Thementag, Effiziente Erschließung digitaler Medien, Berlin.
  • Invited talk: 05.05.2011: Harald Sack, "Semantic Media Explorer - Neue Wege der Suche in Medienarchiven", Leipziger Semantic Web Tag 2011, Leipziger Mediencampus, 5. Mai 2011, Leipzig. [local copy (PDF)]
  • Jörg Waitelonis, Harald Sack:
    Towards exploratory video search using linked data. In Multimedia Tools and Applications 53(2011), pp. 1-28, Springer Netherlands, 2011. (ISSN 1380-7501) [local copy (PDF) | citation (BibTex)]
  • Jörg Waitelonis, Magnus Knuth, Lina Wolf, Johannes Hercher, Harald Sack:
    The Path is the Destination - Enabling a New Search Paradigm with Linked Data. In Proc. of the Workshop on Linked Data in the Future Internet at the Future Internet Assembly, December 16-17, 2010, Ghent, Belgium, CEUR Workshop Proceedings Vol. 700, 2010. (ISSN 1613-0073) [local copy (PDF) | citation (BibTex)]
  • Jörg Waitelonis, Nadine Ludwig, Harald Sack:
    Use What You Have -- Yovisto Video Search Engine Takes a Semantic Turn. In Proc. of 5th Int. Conf. on Semantic and Digital Media (SAMT), December 1-3, 2010, Saarbrücken, Germany, DFKI Saarbrücken, 2010. [local copy (PDF) | citation (BibTex)]
  • Jörg Waitelonis, Harald Sack:
    Exploratory Video Search with yovisto. In Proc. of the 4th Int. Conf. on Semantic Computing (ICSC), September 22-24, 2010, Pittsburgh, USA, IEEE Computer Society, 2010, pp. 446-447. (ISBN 978-1-4244-7912-2 ) [local copy (PDF) | citation (BibTex)]
  • Jörg Waitelonis, Harald Sack, Zalan Kramer, Johannes Hercher:
    Semantically Enabled Exploratory Video Search. In Proc. of the 3rd Int. (WWW), 26-30 April 2010, Raleigh, NC, USA, Semantic Search Workshop at the 19th Int. World Wide Web Conf., ACM, 2010, pp. 1-8. (ISBN 978-1-4503-0130-5 ) [local copy (PDF) | citation (BibTex)]