As militaries increasingly incorporate Artificial Intelligence (AI) into their decision-making architecture, legal and ethical debates have primarily focused on Autonomous Weapon Systems (AWS). This paper argues that equally urgent challenges concern AI-enabled Decision-Support Systems (DSS-AI), even though these systems formally preserve human authority over the use of force. We develop the concept of extended meaningful human control (MHC) to address normative risks posed by DSS-AI in operational environments where time pressure, cognitive constraints, and system opacity converge to marginalize human agency in the decision-making loop. Our argument draws on two scenarios in which the integration of AI in military decision-making is linked to the scarcity of temporal resources—whether inherent (as in nuclear early warning systems) or induced (as in the alleged use of DSS-AI by the Israeli Defense Forces in Gaza). Both cases illustrate how taking critical military decisions at AI speed raises profound ethical and legal concerns. To resist the erosion of MHC, we propose three implementation pathways: human-centered system design, clearly distributed responsibility within command structures, and training programs to counter cognitive and institutional sources of automation bias. These measures should be codified in a multilateral treaty or, failing that, embedded in national doctrines and military manuals to resist the systemic drift toward “warfare at AI speed”.

Warfare at AI Speed and the Extended Meaningful Human Control Problem

Daniele Amoroso
;
2026-01-01

Abstract

As militaries increasingly incorporate Artificial Intelligence (AI) into their decision-making architecture, legal and ethical debates have primarily focused on Autonomous Weapon Systems (AWS). This paper argues that equally urgent challenges concern AI-enabled Decision-Support Systems (DSS-AI), even though these systems formally preserve human authority over the use of force. We develop the concept of extended meaningful human control (MHC) to address normative risks posed by DSS-AI in operational environments where time pressure, cognitive constraints, and system opacity converge to marginalize human agency in the decision-making loop. Our argument draws on two scenarios in which the integration of AI in military decision-making is linked to the scarcity of temporal resources—whether inherent (as in nuclear early warning systems) or induced (as in the alleged use of DSS-AI by the Israeli Defense Forces in Gaza). Both cases illustrate how taking critical military decisions at AI speed raises profound ethical and legal concerns. To resist the erosion of MHC, we propose three implementation pathways: human-centered system design, clearly distributed responsibility within command structures, and training programs to counter cognitive and institutional sources of automation bias. These measures should be codified in a multilateral treaty or, failing that, embedded in national doctrines and military manuals to resist the systemic drift toward “warfare at AI speed”.
File in questo prodotto:
File Dimensione Formato  
978-3-032-29873-7_4.pdf

accesso aperto

Tipologia: versione editoriale (VoR)
Dimensione 168.29 kB
Formato Adobe PDF
168.29 kB Adobe PDF Visualizza/Apri

I metadati presenti in IRIS UNICA sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono protetti da diritto d'autore, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11584/492546
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact