Learning and Reasoning for Cultural Metadata Quality - 3IA Côte d’Azur – Interdisciplinary Institute for Artificial Intelligence Accéder directement au contenu
Article Dans Une Revue Journal on Computing and Cultural Heritage Année : 2022

Learning and Reasoning for Cultural Metadata Quality

Résumé

This work combines semantic reasoning and machine learning to create tools that allow curators of the visual art collections to identify and correct the annotations of the artwork as well as to improve the relevance of the content-based search results in these collections. The research is based on the Joconde database maintained by French Ministry of Culture that contains illustrated artwork records from main French public and private museums representing archeological objects, decorative arts, fine arts, historical and scientific documents, etc. The Joconde database includes semantic metadata that describes properties of the artworks and their content. The developed methods create a data pipeline that processes metadata, trains a Convolutional Neural Network image classification model, makes prediction for the entire collection and expands the metadata to be the base for the SPARQL search queries. We developed a set of such queries to identify noise and silence in the human annotations and to search image content with results ranked according to the relevance of the objects quantified by the prediction score provided by the deep learning model. We also developed methods to discover new contextual relationships between the concepts in the metadata by analyzing the contrast between the concepts similarities in the Joconde's semantic model and other vocabularies and we tried to improve the model prediction scores based on the semantic relations. Our results show that cross-fertilization between symbolic AI and machine learning can indeed provide the tools to address the challenges of the museum curators work describing the artwork pieces and searching for the relevant images.
Fichier principal
Vignette du fichier
Learning and Reasoning for Cultural Metadata Quality.revision2.pdf (1.62 Mo) Télécharger le fichier
Supplementary Materials for Learning and Reasoning for Cultural Metadata Quality.Revision2.pdf (1.17 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03363442 , version 1 (04-10-2021)

Identifiants

Citer

Anna Bobasheva, Fabien Gandon, Frédéric Precioso. Learning and Reasoning for Cultural Metadata Quality. Journal on Computing and Cultural Heritage, 2022, 15 (3), ⟨10.1145/3485844⟩. ⟨hal-03363442⟩
288 Consultations
267 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More