This paper reports some experiments on probabilistic reasoning designed to investigate the impact of the probabilistic problem presentation format (verbal-numerical and graphical-pictorial) on subjects’ confidence in the correctness of their performance, other than the calibration between confidence and accuracy. To understand the potential effect of the format, these dimensions were assessed by monitoring contextual and individual variables: time pressure, numerical and visuospatial abilities, statistical anxiety and attitudes towards statistics. The participants included 257 Psychology students without statistical knowledge, recruited from Italian and Spanish universities, who fulfilled self-report validated measures. The students expressed their retrospective judgments of confidence item-by-item in relation to each probabilistic problem. This approach enabled the computation of two measures of calibration (the Bias Index - the Confidence-Judgment Accuracy Quotient). The results indicated that the problem presentation format did not exert a significant main effect on confidence, with the exception of when the interaction between the format and one subscale of the attitudes towards the statistics test was considered. The Bias Index, however, was significantly related to the interaction between format and time pressure. The study offers a point of reflection in relation to the potential effect exerted by the problem format and time constraint in calibration.

What’s about the Calibration between Confidence and Accuracy? Findings in Probabilistic Problems from Italy and Spain

Agus, Mirian
;
Portoghese, Igor
Membro del Collaboration Group
;
Mascia, Maria Lidia;Penna, Maria Pietronilla
2020-01-01

Abstract

This paper reports some experiments on probabilistic reasoning designed to investigate the impact of the probabilistic problem presentation format (verbal-numerical and graphical-pictorial) on subjects’ confidence in the correctness of their performance, other than the calibration between confidence and accuracy. To understand the potential effect of the format, these dimensions were assessed by monitoring contextual and individual variables: time pressure, numerical and visuospatial abilities, statistical anxiety and attitudes towards statistics. The participants included 257 Psychology students without statistical knowledge, recruited from Italian and Spanish universities, who fulfilled self-report validated measures. The students expressed their retrospective judgments of confidence item-by-item in relation to each probabilistic problem. This approach enabled the computation of two measures of calibration (the Bias Index - the Confidence-Judgment Accuracy Quotient). The results indicated that the problem presentation format did not exert a significant main effect on confidence, with the exception of when the interaction between the format and one subscale of the attitudes towards the statistics test was considered. The Bias Index, however, was significantly related to the interaction between format and time pressure. The study offers a point of reflection in relation to the potential effect exerted by the problem format and time constraint in calibration.
2020
Probabilistic reasoning; Problem format; Reasoning confidence; Performance accuracy; Metacognitive calibration; Time pressure
File in questo prodotto:
File Dimensione Formato  
What_s about the calibration Agus et al 2020.pdf

accesso aperto

Descrizione: PDF articolo Open Access
Tipologia: versione editoriale
Dimensione 752 kB
Formato Adobe PDF
752 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11584/281312
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? ND
social impact