Artificial intelligence is more and more adopted to complement human activity in solving complex tasks in several domains, including healthcare, security, finance, and automation. In order to be effective, several artificial intelligence tools rely on large training sets of carefully annotated data. Since labeling is mostly performed manually, it is a costly and error-prone process. Hence, there is increasing interest in devising innovative tools to support the annotation task. In this paper, we report an initial investigation on the application of EEG data mining for evaluating the performance of humans carrying out image annotation tasks. Our approach relies on a cheap portable EEG sensor and on supervised learning methods. We collected a dataset from five volunteers, and performed an initial evaluation of our technique. The achieved results are promising, and pave the way to several research directions. To the best of our knowledge, our work is the first one applying EEG data mining for assessing the performance of labelers.

Towards EEG-based Performance Assessment in Dataset Annotation Tasks

Massa S. M.;Pibiri M.;Riboni D.
2021

Abstract

Artificial intelligence is more and more adopted to complement human activity in solving complex tasks in several domains, including healthcare, security, finance, and automation. In order to be effective, several artificial intelligence tools rely on large training sets of carefully annotated data. Since labeling is mostly performed manually, it is a costly and error-prone process. Hence, there is increasing interest in devising innovative tools to support the annotation task. In this paper, we report an initial investigation on the application of EEG data mining for evaluating the performance of humans carrying out image annotation tasks. Our approach relies on a cheap portable EEG sensor and on supervised learning methods. We collected a dataset from five volunteers, and performed an initial evaluation of our technique. The achieved results are promising, and pave the way to several research directions. To the best of our knowledge, our work is the first one applying EEG data mining for assessing the performance of labelers.
978-1-6654-0424-2
Attention state
Brain Computer Interface
EEG
Labellig task
Machine learning
Wearable sensors
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11584/335293
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact