Hasso-Plattner-Institut
Prof. Dr. Felix Naumann
  
 

Project Description

Art archives are a rich source of information for multiple reasons: proving the provenance of certain art pieces, facilitating research on art history, and understanding a particular artist with regard to the context of his or her work. These archives typically comprise of various kinds of heterogeneous documents: auction catalogs, personal correspondence, books, exhibition catalogs, bills, certificates, studies, theses, etc. Many of these archives are not easily accessible as they are not yet digitized. Even the ones that are available in digitized form are hard to explore with general text mining tools.

In this project, we aim to facilitate access to a large collection of art related documents. To this end, we need to adapt standard NLP tools to cater to the unique challenges of the art domain. The ultimate goal is to generate a knowledge graph which can be easily explored by art historians. The knowledge graph would also serve as a backbone for semantic search functionality and for new ways to represent art entities, e.g. as embeddings in a high dimensional space. Modern deep learning methods will be developed to manage and visualize large collections of art historical and scholarly documents.

Subprojects

NER4ART

Identification of titles of artworks as named entities is a complex task due to the challenges of this domain. Existing NER tools are not able to perform well for this task due to lack of availability of domain specific training data. In this project, we develop techniques to generate in a semi-automatic manner a large corpus of good quality training data with annotations for artwork titles. Retraining of existing NER tools on this training dataset shows considerable improvement over baseline.

This work was presented at the TPDL 2019 conference held in Oslo, Norway. A full version of the paper is available here.

 

 

Associated Activities

Project-Related Publications

  • Jain, N., Krestel, R.: Who is Mona L.? Identifying Mentions of Artworks in Historical Archives. Lecture Notes in Computer Science, Springer. 11799, 115--122 (2019).