Recent Publications (2023 Onwards)

Towards an End-to-End Framework for Invasive Brain Signal Decoding with Large Language Models

Sheng Feng, Heyang Liu, Yu Wang, Yanfeng Wang

TAIA: Large Language Models are Out-of-Distribution Data Learners

Shuyang Jiang, Yusheng Liao, Ya Zhang, Yu Wang, Yanfeng Wang

SDA: Semantic Discrepancy Alignment for Text-conditioned Image Retrieval

Yuchen Yang, Yu Wang, Yanfeng Wang

Reconstruct the Pruned Model without Any Retraining

Pingjie Wang, Ziqing Fan, Shengchao Hu, Zhe Chen, Yanfeng Wang, Yu Wang

Pruning before Fine-tuning: A Retraining-free Compression Framework for Pre-trained Language Models

Pingjie Wang, Hongcheng Liu, Yu Wang*, Yanfeng Wang

Post-decoder Biasing for End-to-End Speech Recognition of Multi-turn Medical Interview

Heyang Liu, Yu Wang*, Yanfeng Wang

Position: Towards Implicit Prompt For Text-To-Image Models

Yue Yang, Yuqi Lin, Hong Liu, Wenqi Shao, Runjian Chen, Hailong Shang, Yu Wang, Yu Qiao, Kaipeng Zhang, Ping Luo

MSG-BART: Multi-Granularity Scene Graph-Enhanced Encoder-Decoder Language Model for Video-Grounded Dialogue Generation

Hongcheng Liu, Zhe Chen, Hui Li, Pingjie Wang, Yanfeng Wang, Yu Wang*

MM-SAP: A Comprehensive Benchmark for Assessing Self-Awareness of Multimodal Large Language Models in Perception

Yuhao Wang, Yusheng Liao, Heyang Liu, Hongcheng Liu, Yu Wang, Yanfeng Wang

MING-MOE: Enhancing Medical Multi-Task Learning in Large Language Models with Sparse Mixture of Low-Rank Adapter Experts

Yusheng Liao, Shuyang Jiang, Yu Wang, Yanfeng Wang

MedCare: Advancing Medical LLMs through Decoupling Clinical Alignment and Knowledge Aggregation

Yusheng Liao, Shuyang Jiang, Yanfeng Wang, Yu Wang

M2K-VDG: Model-Adaptive Multimodal Knowledge Anchor Enhanced Video-grounded Dialogue Generation

Hongcheng Liu, Pingjie Wang, Yu Wang*, Yanfeng Wang

M $^3$ AV: A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset

Zhe Chen, Heyang Liu, Wenyi Yu, Guangzhi Sun, Hongcheng Liu, Ji Wu, Chao Zhang, Yu Wang, Yanfeng Wang

LibriSQA: Pioneering Free-form and Open-ended Spoken Question Answering with a Novel Dataset and Framework

Zihan Zhao, Yiyang Jiang, Heyang Liu, Yanfeng Wang, Yu Wang

Leveraging Diverse Modeling Contexts with Collaborating Learning for Neural Machine Translation

Yusheng Liao, Yanfeng Wang, Yu Wang

DictLLM: Harnessing Key-Value Data Structures with Large Language Models for Enhanced Medical Diagnostics

YiQiu Guo, Yuchen Yang, Ya Zhang, Yu Wang, Yanfeng Wang

Decoding Linguistic Representations of Human Brain

Yu Wang, Heyang Liu, Yuhao Wang, Chuan Xuan, Yixuan Hou, Sheng Feng, Hongcheng Liu, Yusheng Liao, Yanfeng Wang

CF-TCIR: A Compositor-Free Framework for Hierarchical Text-Conditioned Image Retrieval

Yuchen Yang, Yu Wang, Yanfeng Wang

CE-VDG: Counterfactual Entropy-based Bias Reduction for Video-grounded Dialogue Generation

Hongcheng Liu, Pingjie Wang, Zhiyuan Zhu, Yu Wang*, Yanfeng Wang

Automatic Interactive Evaluation for Large Language Models with State Aware Patient Simulator

Yusheng Liao, Yutong Meng, Yuhao Wang, Hongcheng Liu, Yanfeng Wang, Yu Wang*

Uncertainty-Guided End-to-End Audio-Visual Speaker Diarization for Far-Field Recordings

Chenyu Yang, Mengxi Chen, Yanfeng Wang, Yu Wang*

Towards Optimizing Pre-trained Language Model Ensemble Learning for Task-oriented Dialogue System

Zhiyuan Zhu, Yusheng Liao, Zhe Chen, Yu Wang*, Yunfeng Guan

Selfevolve: A code evolution framework via large language models

Shuyang Jiang, Yuhao Wang, Yu Wang*

Self-Improvement of Non-autoregressive Model via Sequence-Level Distillation

Yusheng Liao, Shuyang Jiang, Yiqi Li, Yu Wang*, Yanfeng Wang

Robust End-to-end Speaker Diarization with Generic Neural Clustering

Chenyu Yang, Yu Wang*

Redundancy-Adaptive Multimodal Learning for Imperfect Data

Mengxi Chen, Jiangchao Yao, Linyu Xing, Yu Wang*, Ya Zhang, Yanfeng Wang

Multi-level Fusion of Wav2vec 2.0 and BERT for Multimodal Emotion Recognition

Zihan Zhao, Yanfeng Wang, Yu Wang*

Knowledge-aware bayesian co-attention for multimodal emotion recognition

Zihan Zhao, Yu Wang*, Yanfeng Wang

Improving the Reliability of Large Language Models by Leveraging Uncertainty-Aware In-Context Learning

Yuchen Yang, Houqiang Li, Yanfeng Wang, Yu Wang*

Fine-Grained Heart Sound Classification for Congenital Heart Defects Using Multiple Deep Learning Techniques

Yiyang Jiang, Zihan Zhao, Yuxin Duan, Yan-Feng Wang, Xin Sun, Yu Wang*

Enhanced multimodal representation learning with cross-modal KD

Mengxi Chen, Linyu Xing, Yu Wang*, Ya Zhang

DialogMCF: Multimodal Context Flow for Audio Visual Scene-Aware Dialog

Zhe Chen, Hongcheng Liu, Yu Wang*

Contrastive Learning Based ASR Robust Knowledge Selection For Spoken Dialogue System

Zhiyuan Zhu, Yusheng Liao, Yu Wang*, Yunfeng Guan

An Automatic Evaluation Framework for Multi-turn Medical Consultations Capabilities of Large Language Models

Yusheng Liao, Yutong Meng, Hongcheng Liu, Yanfeng Wang, Yu Wang*

A Comparative Study of Pre-trained Audio and Speech Models for Heart Sound Detection

Yuxin Duan, Chenyu Yang, Zihan Zhao, Yiyang Jiang, Yanfeng Wang, Yu Wang*

Improving low-resource sound event localization and detection via active learning with domain adaptation

Yuhao Wang, Yuxin Duan, Pingjie Wang, Yu Wang, Wei Xue