Background This review examines enhancements to the U-Net's ability to represent complex spatial structures for segmentation through attention mechanisms. The study surveys applications across both medical and non-medical domains, focusing on cSAM, cCAM, CBAM, and their associated serial (sfSCAM) and parallel (pfSCAM) fusion architectures. Beyond accuracy, the analysis also considers backbone design, diversity of evaluation metrics, pruning strategies, and potential sources of bias. Methodology Following PRISMA guidelines, we systematically searched major academic databases using U-Net- and attention-related keywords. The final corpus was constructed through stepwise exclusions (E1–E3) from an initial set of 1807 retrieved records. Spatial, channel, and hybrid attention modules were taxonomized; their placement within encoder, decoder, skip, and bottleneck blocks was identified; and application trends across domains such as liver, brain, skin, and retinal imaging were summarized. Findings Attention-augmented U-Net models consistently improved the segmentation of subtle, scale-dependent structures across modalities, including CT, MRI, ultrasound, dermoscopy, fundus, and satellite imaging. Spatial attention in skip connections and decoders reduced noise while preserving boundaries, whereas encoder-level channel attention improved semantic weighting; CBAM combined both effects. Parallel fusion (pfSCAM) balanced accuracy and efficiency, while serial fusion (sfSCAM) enabled stable feature refinement. Attention placement strongly influenced global–local fusion and noise suppression. Pruning reduced computational cost with minimal performance loss, although evaluation remained focused on Dice and cross-entropy, with limited use of IoU, Hausdorff distance, and F1-score. Conclusion Spatial and channel attention, along with their serial and parallel fusion variants, function as structural design principles within the U-Net. Effective practice integrates careful module placement, pruning or quantization strategies, and explicit bias auditing.

Attention mechanisms in UNet variants for medical/non-medical image segmentation: A comprehensive and state-of-the-art narrative review

Faa, Gavino;Saba, Luca
Penultimo
;
2026-01-01

Abstract

Background This review examines enhancements to the U-Net's ability to represent complex spatial structures for segmentation through attention mechanisms. The study surveys applications across both medical and non-medical domains, focusing on cSAM, cCAM, CBAM, and their associated serial (sfSCAM) and parallel (pfSCAM) fusion architectures. Beyond accuracy, the analysis also considers backbone design, diversity of evaluation metrics, pruning strategies, and potential sources of bias. Methodology Following PRISMA guidelines, we systematically searched major academic databases using U-Net- and attention-related keywords. The final corpus was constructed through stepwise exclusions (E1–E3) from an initial set of 1807 retrieved records. Spatial, channel, and hybrid attention modules were taxonomized; their placement within encoder, decoder, skip, and bottleneck blocks was identified; and application trends across domains such as liver, brain, skin, and retinal imaging were summarized. Findings Attention-augmented U-Net models consistently improved the segmentation of subtle, scale-dependent structures across modalities, including CT, MRI, ultrasound, dermoscopy, fundus, and satellite imaging. Spatial attention in skip connections and decoders reduced noise while preserving boundaries, whereas encoder-level channel attention improved semantic weighting; CBAM combined both effects. Parallel fusion (pfSCAM) balanced accuracy and efficiency, while serial fusion (sfSCAM) enabled stable feature refinement. Attention placement strongly influenced global–local fusion and noise suppression. Pruning reduced computational cost with minimal performance loss, although evaluation remained focused on Dice and cross-entropy, with limited use of IoU, Hausdorff distance, and F1-score. Conclusion Spatial and channel attention, along with their serial and parallel fusion variants, function as structural design principles within the U-Net. Effective practice integrates careful module placement, pruning or quantization strategies, and explicit bias auditing.
2026
Attention
Convolution/non-convolution
Pruning
Segmentation
UNet
transformers
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I metadati presenti in IRIS UNICA sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono protetti da diritto d'autore, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11584/488952
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact