Deng, Shijian

1. AV-DiT: Efficient Audio-Visual Diffusion Transformer for Joint Audio and Video Generation
   2024/06/11 by Kai Wang, Wang, Kai, Shijian Deng +7 · 9 citations
   Computer Science · Engineering · #Advanced Adaptive Filtering Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Music and Audio Processing #Speech and Audio Processing
2. Towards Online Multi-Modal Social Interaction Understanding
   2025/03/25 by Li, Xinpeng, Deng, Shijian, Lai, Bolin +3 · 5 citations
   #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
3. Continual Audio-Visual Sound Separation
   2024/11/05 by Weiguo Pian, Yiyang Nan, Pian, Weiguo +9 · 3 citations
   Computer Science · #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Signal Denoising Methods #Machine Learning (cs.LG) #Multimedia (cs.MM) #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
4. Hear Me, See Me, Understand Me: Audio-Visual Autism Behavior Recognition
   2024/03/22 by Shijian Deng, Erin E. Kosloski, Deng, Shijian +21 · 2 citations
   Computer Science · Neuroscience · Social Sciences · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Autism Spectrum Disorder Research #Child Development and Digital Technology #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimedia (cs.MM) #Music and Audio Processing #electronic engineering #information engineering
5. Separating Invisible Sounds Toward Universal Audiovisual Scene-Aware Sound Separation
   2023/10/18 by Yiyang Su, Ali Vosoughi, Su, Yiyang +7 · 1 citation
   Computer Science · Engineering · Neuroscience · #Advanced Adaptive Filtering Techniques #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Hearing Loss and Rehabilitation #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
6. Efficient Self-Improvement in Multimodal Large Language Models: A Model-Level Judge-Free Approach
   2024/11/26 by Deng, Shijian, Zhao, Wentian, Li, Yu-Jhe +4 · 2 citations
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
7. Modality-Inconsistent Continual Learning of Multimodal Large Language Models
   2024/12/17 by Weiguo Pian, Shijian Deng, Pian, Weiguo +8 · 1 citation
   Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #Topic Modeling #electronic engineering #information engineering