MEET: the music event emotion tracking metaverse

This paper presents the Music Event Emotion Tracking (MEET) Metaverse, which is one of the demo results produced within the FUN-Media project. The MEET Metaverse is a virtual disco where multiple users can join together through their avatars to enjoy musical events. The peculiar characteristic of the MEET Metaverse is that the emotions of participants are inferred from their facial expressions and speech, and are used to select the next song to be played in the disco based on the average emotional state of participants. Moreover, avatars' facial poses are updated based on participants' emotions, and realistic avatar animations are reproduced using a combination of motion retargeting and high-fidelity appearance modeling.