Enhancing the performance of personal identity authentication systems by fusion of face verification experts

We investigate the behavior knowledge space method (see Xu, L. et al., IEEE Transactions SMC,2, no.3, p.418-35, 1992) and decision templates method (see Kuncheva, L. et al., Pattern Recognition, vol.34, p.299-314, 2001) of classifier fusion in the context of face verification. The study involves six experts which are not only correlated, but also their performance levels differ by as much as a factor of three. Through extensive experiments on the XM2VTS database using the Lausanne protocol, we found that the behavior knowledge space fusion strategy achieved consistently better results than the decision templates method. Most importantly, it exhibited quasi monotonic behavior as the number of experts combined increased. This is a very important conclusion, as it means that the performance of the multimodal system is not degraded by adding experts.