Recent Publications (2023 Onwards)

MING-MOE: Enhancing Medical Multi-Task Learning in Large Language Models with Sparse Mixture of Low-Rank Adapter Experts
Yusheng Liao, Shuyang Jiang, Yu Wang*, Yanfeng Wang
Cite Project
Pruning before Fine-tuning: A Retraining-free Compression Framework for Pre-trained Language Models
Pingjie Wang, Hongcheng Liu, Yu Wang*, Yanfeng Wang
Cite Project
Post-decoder Biasing for End-to-End Speech Recognition of Multi-turn Medical Interview
Heyang Liu, Yu Wang*, Yanfeng Wang
Cite
Position Paper: Towards Implicit Prompt For Text-To-Image Models
Yue Yang, Hong Liu, Wenqi Shao, Runjian Chen, Hailong Shang, Yu Wang*, Yu Qiao, Kaipeng Zhang, Ping Luo, Others
Cite
MSG-BART: Multi-Granularity Scene Graph-Enhanced Encoder-Decoder Language Model for Video-Grounded Dialogue Generation
Hongcheng Liu, Zhe Chen, Hui Li, Pingjie Wang, Yanfeng Wang, Yu Wang*
Cite Project
MM-SAP: A Comprehensive Benchmark for Assessing Self-Awareness of Multimodal Large Language Models in Perception
Yuhao Wang, Yusheng Liao, Heyang Liu, Hongcheng Liu, Yu Wang*, Yanfeng Wang
Cite Project
M2K-VDG: Model-Adaptive Multimodal Knowledge Anchor Enhanced Video-grounded Dialogue Generation
Hongcheng Liu, Pingjie Wang, Yu Wang*, Yanfeng Wang
Cite Project
M $^3$ AV: A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset
Zhe Chen, Heyang Liu, Wenyi Yu, Guangzhi Sun, Hongcheng Liu, Ji Wu, Chao Zhang*, Yu Wang*, Yanfeng Wang
Cite Project
Leveraging Diverse Modeling Contexts with Collaborating Learning for Neural Machine Translation
Yusheng Liao, Yanfeng Wang, Yu Wang*
Cite
DictLLM: Harnessing Key-Value Data Structures with Large Language Models for Enhanced Medical Diagnostics
YiQiu Guo, Yuchen Yang, Ya Zhang, Yu Wang*, Yanfeng Wang
Cite Project
CE-VDG: Counterfactual Entropy-based Bias Reduction for Video-grounded Dialogue Generation
Hongcheng Liu, Pingjie Wang, Zhiyuan Zhu, Yu Wang*, Yanfeng Wang
Cite
Automatic Interactive Evaluation for Large Language Models with State Aware Patient Simulator
Yusheng Liao, Yutong Meng, Yuhao Wang, Hongcheng Liu, Yanfeng Wang, Yu Wang*
Cite Project
Uncertainty-Guided End-to-End Audio-Visual Speaker Diarization for Far-Field Recordings
Chenyu Yang, Mengxi Chen, Yanfeng Wang, Yu Wang*
Cite Project
Towards Optimizing Pre-trained Language Model Ensemble Learning for Task-oriented Dialogue System
Zhiyuan Zhu, Yusheng Liao, Zhe Chen, Yu Wang*, Yunfeng Guan
Cite Project
Selfevolve: A code evolution framework via large language models
Shuyang Jiang, Yuhao Wang, Yu Wang*
Cite Project
Self-Improvement of Non-autoregressive Model via Sequence-Level Distillation
Yusheng Liao, Shuyang Jiang, Yiqi Li, Yu Wang*, Yanfeng Wang
Cite
Robust End-to-end Speaker Diarization with Generic Neural Clustering
Chenyu Yang, Yu Wang*
Cite
Redundancy-Adaptive Multimodal Learning for Imperfect Data
Mengxi Chen, Jiangchao Yao, Linyu Xing, Yu Wang*, Ya Zhang, Yanfeng Wang
Cite
Multi-level Fusion of Wav2vec 2.0 and BERT for Multimodal Emotion Recognition
Zihan Zhao, Yanfeng Wang, Yu Wang*
Cite
LibriSQA: Pioneering Free-form and Open-ended Spoken Question Answering with a Novel Dataset and Framework
Zihan Zhao, Yiyang Jiang, Heyang Liu, Yanfeng Wang, Yu Wang*
Cite Project
Knowledge-aware bayesian co-attention for multimodal emotion recognition
Zihan Zhao, Yu Wang*, Yanfeng Wang
Cite Project
Improving the Reliability of Large Language Models by Leveraging Uncertainty-Aware In-Context Learning
Yuchen Yang, Houqiang Li, Yanfeng Wang, Yu Wang*
Cite Project
Fine-Grained Heart Sound Classification for Congenital Heart Defects Using Multiple Deep Learning Techniques
Yiyang Jiang, Zihan Zhao, Yuxin Duan, Yan-Feng Wang, Xin Sun, Yu Wang*
Cite
Enhanced multimodal representation learning with cross-modal KD
Mengxi Chen, Linyu Xing, Yu Wang*, Ya Zhang
Cite
DialogMCF: Multimodal Context Flow for Audio Visual Scene-Aware Dialog
Zhe Chen, Hongcheng Liu, Yu Wang*
Cite
Contrastive Learning Based ASR Robust Knowledge Selection For Spoken Dialogue System
Zhiyuan Zhu, Yusheng Liao, Yu Wang*, Yunfeng Guan
Cite Project
An Automatic Evaluation Framework for Multi-turn Medical Consultations Capabilities of Large Language Models
Yusheng Liao, Yutong Meng, Hongcheng Liu, Yanfeng Wang, Yu Wang*
Cite
A Comparative Study of Pre-trained Audio and Speech Models for Heart Sound Detection
Yuxin Duan, Chenyu Yang, Zihan Zhao, Yiyang Jiang, Yanfeng Wang, Yu Wang*
Cite