vix.ing · top · new · best · stats · spec

Fang, Qingkai

  1. LLaMA-Omni: Seamless Speech Interaction with Large Language Models
    2024/09/10 by Qingkai Fang, Fang, Qingkai, Shoutao Guo +9 · 40 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #I.2.7 #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and dialogue systems #electronic engineering #information engineering
  2. LLaVA-Mini: Efficient Image and Video Large Multimodal Models with One Vision Token
    2025/01/07 by Zhang, Shaolei, Fang, Qingkai, Yang, Zhe +1 · 42 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  3. LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesis
    2025/05/05 by Fang, Qingkai, Zhou, Yan, Guo, Shoutao +2 · 19 citations
    #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
  4. STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation
    2022/03/20 by Fang, Qingkai, Ye, Rong, Li, Lei +2 · 3 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7
  5. CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation
    2023/05/24 by Yan Zhou, Zhou, Yan, Qingkai Fang +3 · 3 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #Topic Modeling #electronic engineering #information engineering
  6. StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning
    2024/06/05 by Shaolei Zhang, Zhang, Shaolei, Qingkai Fang +9 · 4 citations
    Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #Speech Recognition and Synthesis
  7. Understanding and Bridging the Modality Gap for Speech Translation
    2023/05/15 by Qingkai Fang, Fang, Qingkai, Yan Feng +1 · 2 citations
    Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #I.2.7 #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Sound (cs.SD) #Topic Modeling #electronic engineering #information engineering
  8. Stream-Omni: Simultaneous Multimodal Interactions with Large Language-Vision-Speech Model
    2025/06/16 by Zhang, Shaolei, Guo, Shoutao, Fang, Qingkai +2 · 6 citations
    #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
  9. Can We Achieve High-quality Direct Speech-to-Speech Translation without Parallel Speech Data?
    2024/06/11 by Qingkai Fang, Fang, Qingkai, Shaolei Zhang +7 · 2 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #I.2.7 #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and dialogue systems #electronic engineering #information engineering
  10. Neural Machine Translation with Phrase-Level Universal Visual Representations
    2022/03/19 by Qingkai Fang, Yan Feng, Fang, Qingkai +1 · 1 citation
    Computer Science · #Natural Language Processing Techniques #Multimodal Machine Learning Applications #Topic Modeling
  11. Low-resource Neural Machine Translation with Cross-modal Alignment
    2022/10/13 by Yang, Zhe, Fang, Qingkai, Feng, Yang · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  12. BayLing: Bridging Cross-lingual Alignment and Instruction Following through Interactive Translation for Large Language Models
    2023/06/19 by Zhang, Shaolei, Fang, Qingkai, Zhang, Zhuocheng +8 · 1 citation
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  13. Back Translation for Speech-to-text Translation Without Transcripts
    2023/05/15 by Qingkai Fang, Fang, Qingkai, Yan Feng +1 · 1 citation
    Computer Science · Biochemistry, Genetics and Molecular Biology · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Cancer-related molecular mechanisms research
  14. BayLing 2: A Multilingual Large Language Model with Efficient Language Alignment
    2024/11/25 by Shaolei Zhang, Zhang, Shaolei, Zhang, Kehao +10 · 3 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  15. DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation
    2023/10/11 by Fang, Qingkai, Zhou, Yan, Feng, Yang · 1 citation
    #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #I.2.7 #Sound (cs.SD) #electronic engineering #information engineering
  16. CTC-based Non-autoregressive Textless Speech-to-Speech Translation
    2024/06/11 by Fang, Qingkai, Ma, Zhengrui, Zhou, Yan +2 · 1 citation
    #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #I.2.7 #Sound (cs.SD) #electronic engineering #information engineering
  17. FastLongSpeech: Enhancing Large Speech-Language Models for Efficient Long-Speech Processing
    2025/07/20 by Guo, Shoutao, Zhang, Shaolei, Fang, Qingkai +3 · 2 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences