In an increasingly connected world, where people from different countries work closely together to pursue common goals, language barriers remain a significant obstacle to seamless communication. This issue becomes even more critical in emergency situations, where urgent messages must be conveyed immediately to multiple recipients, minimizing the risk of misunderstanding due to limited knowledge of the local language. To address this challenge, we propose a novel system for near real-time voice translation that preserves the tone of urgency. Our system incorporates advanced artificial intelligence components for speech recognition, urgency detection, machine translation, and speech synthesis. Being specifically tailored for urgency detection and urgency-aware translation, it enhances state-of-the-art translation technologies by preserving the urgency tone, which is often lost in conventional systems. We developed a working prototype of our system and conducted experiments that show the efficiency and low latency of our solution.

Translate, Now! Near Real-Time Speech-to-Speech Translation with Urgency Preservation

Malloci F. M.;Marras M.;Reforgiato Recupero D.
;
Riboni D.;Scarpi G.
2025-01-01

Abstract

In an increasingly connected world, where people from different countries work closely together to pursue common goals, language barriers remain a significant obstacle to seamless communication. This issue becomes even more critical in emergency situations, where urgent messages must be conveyed immediately to multiple recipients, minimizing the risk of misunderstanding due to limited knowledge of the local language. To address this challenge, we propose a novel system for near real-time voice translation that preserves the tone of urgency. Our system incorporates advanced artificial intelligence components for speech recognition, urgency detection, machine translation, and speech synthesis. Being specifically tailored for urgency detection and urgency-aware translation, it enhances state-of-the-art translation technologies by preserving the urgency tone, which is often lost in conventional systems. We developed a working prototype of our system and conducted experiments that show the efficiency and low latency of our solution.
2025
9781643686318
Artificial intelligence; Computer aided language translation; Machine translation; Speech communication; Speech synthesis; Speech transmission
File in questo prodotto:
File Dimensione Formato  
_ECAI_2025_DP__Translate__Now__Near_Real_Time_Speech_to_Speech_Translation_with_Urgency_Preservation-2.pdf

accesso aperto

Tipologia: versione editoriale (VoR)
Dimensione 217.27 kB
Formato Adobe PDF
217.27 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11584/480206
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact