MPD

Multimodal dialogue and perception enhance human-machine interaction by integrating various communication forms and sensory inputs for more natural and intuitive exchanges. Our research focuses on： multi-turn video-grounded dialogue generation, speech perception and understanding and multimodel representation learning.