Gong, Yuan
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Eric Bieber, Comanici, Gheorghe +6844 · 8 voices · 1350 citations
#cs.CL #cs.AI
- AST: Audio Spectrogram Transformer
2021/04/05 by Yuan Gong, Gong, Yuan, Yu-An Chung +3 · 98 citations
Computer Science · #Music and Audio Processing #Speech and Audio Processing #Speech Recognition and Synthesis
- MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment
2022/04/19 by Sidi Yang, Yang, Sidi, Tianhe Wu +13 · 88 citations
Computer Science · Engineering · #Advanced Image Fusion Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Image and Video Quality Assessment #Visual Attention and Saliency Detection #electronic engineering #information engineering
- Listen, Think, and Understand
2023/05/18 by Yuan Gong, Gong, Yuan, Hongyin Luo +7 · 35 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- SSAST: Self-Supervised Audio Spectrogram Transformer
2021/10/19 by Yuan Gong, Gong, Yuan, Cheng-I Lai +5 · 24 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Contrastive Audio-Visual Masked Autoencoder
2022/10/02 by Yuan Gong, Andrew Rouditchenko, Gong, Yuan +11 · 17 citations
Computer Science · #Music and Audio Processing #Speech and Audio Processing #Video Analysis and Summarization
- Joint Audio and Speech Understanding
2023/09/25 by Gong, Yuan, Liu, Alexander H., Luo, Hongyin +2 · 21 citations
#Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model
2022/10/11 by Ji, Yatai, Wang, Junjie, Gong, Yuan +6 · 10 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimedia (cs.MM)
- Focal and Global Knowledge Distillation for Detectors
2021/11/23 by Yang, Zhendong, Li, Zhe, Jiang, Xiaohu +4 · 8 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Network
2022/04/22 by Shanshan Lao, Yuan Gong, Lao, Shanshan +13 · 8 citations
Computer Science · Engineering · #Advanced Image Fusion Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image and Video Quality Assessment #Visual Attention and Saliency Detection
- Animate-A-Story: Storytelling with Retrieval-Augmented Video Generation
2023/07/13 by He, Yingqing, Xia, Menghan, Chen, Haoxin +8 · 8 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation
2024/06/14 by Rouditchenko, Andrew, Gong, Yuan, Thomas, Samuel +4 · 11 citations
#Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluations
2025/06/16 by Kaiyuan Chen, Yixin Ren, Chen, Kaiyuan +58 · 27 citations
Business, Management and Accounting · Computer Science · #Business Process Modeling and Analysis #Multi-Agent Systems and Negotiation
- TaleCrafter: Interactive Story Visualization with Multiple Characters
2023/05/29 by Yuan Gong, Youxin Pang, Gong, Yuan +19 · 6 citations
Engineering · Computer Science · #Human Motion and Animation #Video Analysis and Summarization #Multimodal Machine Learning Applications
- Revise, Reason, and Recognize: LLM-Based Emotion Recognition via Emotion-Specific Prompts and ASR Error Correction
2024/09/23 by Yuanchao Li, Yuan Gong, Li, Yuanchao +7 · 5 citations
Psychology · Computer Science · #Emotion and Mood Recognition #Sentiment Analysis and Opinion Mining #Anomaly Detection Techniques and Applications
- SAIL: Search-Augmented Instruction Learning
2023/05/24 by Luo, Hongyin, Chuang, Yung-Sung, Gong, Yuan +6 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- ToonTalker: Cross-Domain Face Reenactment
2023/08/24 by Yuan Gong, Yong Zhang, Gong, Yuan +13 · 2 citations
Computer Science · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face recognition and analysis #Generative Adversarial Networks and Image Synthesis
- Natural Language Embedded Programs for Hybrid Language Symbolic Reasoning
2023/09/19 by Zhang, Tianhua, Ge, Jiaxin, Luo, Hongyin +7 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- An Overview of Vulnerabilities of Voice Controlled Systems
2018/03/24 by Gong, Yuan, Poellabauer, Christian · 1 citation
#Artificial Intelligence (cs.AI) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences
- AER-LLM: Ambiguity-aware Emotion Recognition Leveraging Large Language Models
2024/09/26 by Hong, Xin, Gong, Yuan, Sethu, Vidhyasaharan +1 · 3 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- ReMASC: Realistic Replay Attack Corpus for Voice Controlled Systems
2019/04/06 by Gong, Yuan, Yang, Jian, Huber, Jacob +2 · 1 citation
#Audio and Speech Processing (eess.AS) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Sound (cs.SD) #electronic engineering #information engineering
- State-Space Large Audio Language Models
2024/11/24 by Saurabhchand Bhati, Yuan Gong, Bhati, Saurabhchand +9 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Speech Recognition and Synthesis #electronic engineering #information engineering
- Rethinking Knowledge Distillation via Cross-Entropy
2022/08/22 by Zhendong Yang, Zhe Li, Yang, Zhendong +11 · 1 citation
Computer Science · Neuroscience · #Advanced Neural Network Applications #Brain Tumor Detection and Classification #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
- 3D GAN Inversion with Facial Symmetry Prior
2022/11/30 by Fei Yin, Yong Zhang, Yin, Fei +19 · 1 citation
Computer Science · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face recognition and analysis #Generative Adversarial Networks and Image Synthesis
- UniWav: Towards Unified Pre-training for Speech Representation Learning and Generation
2025/03/02 by Alexander H. Liu, Sang-gil Lee, Liu, Alexander H. +13 · 3 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and dialogue systems #electronic engineering #information engineering
- CAV-MAE Sync: Improving Contrastive Audio-Visual Mask Autoencoders via Fine-Grained Alignment
2025/05/02 by Araujo, Edson, Rouditchenko, Andrew, Gong, Yuan +7 · 2 citations
#Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Sound (cs.SD) #electronic engineering #information engineering
- OneReward: Unified Mask-Guided Image Generation via Multi-Task Human Preference Learning
2025/08/28 by Yuan Gong, Xionghui Wang, Gong, Yuan +9 · 7 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face recognition and analysis #Generative Adversarial Networks and Image Synthesis
- Large Language Model Based Generative Error Correction: A Challenge and Baselines for Speech Recognition, Speaker Tagging, and Emotion Recognition
2024/09/15 by Chao-Han Huck Yang, Yang, Chao-Han Huck, Taejin Park +39 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- Nonreciprocal Bistability in Coupled Nonlinear Cavity Magnonics
2023/09/17 by Wei Xiong, Xiong, Wei, Gong, Yuan +4 · 1 citation
Computer Science · Engineering · Physics and Astronomy · #FOS: Physical sciences #Mechanical and Optical Resonators #Mesoscale and Nanoscale Physics (cond-mat.mes-hall) #Neural Networks and Reservoir Computing #Photonic and Optical Devices #Quantum Physics (quant-ph)
- A Closer Look at Neural Codec Resynthesis: Bridging the Gap between Codec and Waveform Generation
2024/10/29 by Alexander H. Liu, Qirui Wang, Liu, Alexander H. +5 · 1 citation
Computer Science · #Neural Networks and Applications