A Visual Attentive Model for Discovering Patterns in Eye-Tracking Data-A Proposal in Cultural Heritage.

Deep Convolutional Neural Networks Digital Cultural Heritage eye-tracking

Journal

Sensors (Basel, Switzerland)
ISSN: 1424-8220
Titre abrégé: Sensors (Basel)
Pays: Switzerland
ID NLM: 101204366

Informations de publication

Date de publication:
08 Apr 2020
Historique:
received: 24 02 2020
revised: 27 03 2020
accepted: 05 04 2020
entrez: 12 4 2020
pubmed: 12 4 2020
medline: 12 4 2020
Statut: epublish

Résumé

In the Cultural Heritage (CH) context, art galleries and museums employ technology devices to enhance and personalise the museum visit experience. However, the most challenging aspect is to determine what the visitor is interested in. In this work, a novel Visual Attentive Model (VAM) has been proposed that is learned from eye tracking data. In particular, eye-tracking data of adults and children observing five paintings with similar characteristics have been collected. The images are selected by CH experts and are-the three "Ideal Cities" (Urbino, Baltimore and Berlin), the Inlaid chest in the National Gallery of Marche and Wooden panel in the "Studiolo del Duca" with Marche view. These pictures have been recognized by experts as having analogous features thus providing coherent visual stimuli. Our proposed method combines a new coordinates representation from eye sequences by using Geometric Algebra with a deep learning model for automated recognition (to identify, differentiate, or authenticate individuals) of people by the attention focus of distinctive eye movement patterns. The experiments were conducted by comparing five Deep Convolutional Neural Networks (DCNNs), yield high accuracy (more than 80 %), demonstrating the effectiveness and suitability of the proposed approach in identifying adults and children as museums' visitors.

Identifiants

pubmed: 32276462
pii: s20072101
doi: 10.3390/s20072101
pmc: PMC7180873
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Références

PLoS One. 2012;7(5):e37285
pubmed: 22624007
IEEE Trans Image Process. 2018 Jun 29;:
pubmed: 29994710
Neuropsychologia. 2019 Jun;129:397-406
pubmed: 31071324
Front Hum Neurosci. 2011 Sep 12;5:98
pubmed: 21941476
Sensors (Basel). 2019 Mar 21;19(6):
pubmed: 30901817
J Biomed Inform. 2017 May;69:218-229
pubmed: 28410981
Vision Res. 2010 Jul 21;50(16):1503-9
pubmed: 20580643
Int J Med Inform. 2019 Sep;129:366-373
pubmed: 31445278

Auteurs

Roberto Pierdicca (R)

Dipartimento di Ingegneria Civile, Edile e dell'Architettura, Universitá Politecnica delle Marche, 60131 Ancona, Italy.

Marina Paolanti (M)

Dipartimento di Ingegneria dell'Informazione, Universitá Politecnica delle Marche, 60131 Ancona, Italy.

Ramona Quattrini (R)

Dipartimento di Ingegneria Civile, Edile e dell'Architettura, Universitá Politecnica delle Marche, 60131 Ancona, Italy.

Marco Mameli (M)

Dipartimento di Ingegneria dell'Informazione, Universitá Politecnica delle Marche, 60131 Ancona, Italy.

Emanuele Frontoni (E)

Dipartimento di Ingegneria dell'Informazione, Universitá Politecnica delle Marche, 60131 Ancona, Italy.

Classifications MeSH