Objective: Artificial intelligence (AI) is increasingly used in dental research for diagnosis, treatment planning, and disease prediction. However, many dental AI studies lack methodological rigor, transparency, or reproducibility, and no dedicated peer-review guidance exists for this field. Methods: Editors and reviewers from the ITU/WHO/WIPO AI for Health – Dentistry group participated in a structured survey and group discussions to identify key elements for reviewing AI dental research. A draft of the recommendations was circulated for feedback and consensus. Results: The consensus from editors and reviewers identified four key indicators of high-quality AI dental research: (1) relevance to a real clinical or methodological problem, (2) robust and transparent methodology, (3) reproducibility through data/code availability or functional demos, and (4) adherence to ethical and responsible reporting practices. Common reasons for rejection included lack of novelty, poor methodology, limited external testing, and overstated claims. Four essential checks were proposed to support peer review: the study should address a meaningful clinical question, follow appropriate reporting guidelines (e.g., DENTAL-AI, STARD-AI), clearly describe reproducible methods, and use precise, justified, and clinically relevant wording. Conclusion: Editors and reviewers play a critical role in improving the quality of AI research in dentistry. This guidance aims to support more robust peer review and contribute to the development of reliable, clinically relevant, and ethically sound AI applications in dentistry.

Evaluating dental AI research papers: Key considerations for editors and reviewers

Valente, Nicola Alberto;
2025-01-01

Abstract

Objective: Artificial intelligence (AI) is increasingly used in dental research for diagnosis, treatment planning, and disease prediction. However, many dental AI studies lack methodological rigor, transparency, or reproducibility, and no dedicated peer-review guidance exists for this field. Methods: Editors and reviewers from the ITU/WHO/WIPO AI for Health – Dentistry group participated in a structured survey and group discussions to identify key elements for reviewing AI dental research. A draft of the recommendations was circulated for feedback and consensus. Results: The consensus from editors and reviewers identified four key indicators of high-quality AI dental research: (1) relevance to a real clinical or methodological problem, (2) robust and transparent methodology, (3) reproducibility through data/code availability or functional demos, and (4) adherence to ethical and responsible reporting practices. Common reasons for rejection included lack of novelty, poor methodology, limited external testing, and overstated claims. Four essential checks were proposed to support peer review: the study should address a meaningful clinical question, follow appropriate reporting guidelines (e.g., DENTAL-AI, STARD-AI), clearly describe reproducible methods, and use precise, justified, and clinically relevant wording. Conclusion: Editors and reviewers play a critical role in improving the quality of AI research in dentistry. This guidance aims to support more robust peer review and contribute to the development of reliable, clinically relevant, and ethically sound AI applications in dentistry.
2025
Artificial intelligence
Deep learning
Dentistry
Machine learning
Peer-review
File in questo prodotto:
File Dimensione Formato  
1-s2.0-S0300571225003112-main.pdf

accesso aperto

Descrizione: Articolo principale
Tipologia: versione editoriale (VoR)
Dimensione 540.35 kB
Formato Adobe PDF
540.35 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11584/447667
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 0
social impact