Du, Jingfei
- RoBERTa: A Robustly Optimized BERT Pretraining Approach
2019/07/26 by Liu, Yinhan, Ott, Myle, Goyal, Naman +7 · 831 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Efficient Large Scale Language Modeling with Mixtures of Experts
2021/12/20 by Mikel Artetxe, Artetxe, Mikel, Shruti Bhosale +47 · 1 voice · 16 citations
Computer Science · #Topic Modeling #Expert finding and Q&A systems #Machine Learning in Healthcare
- Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning
2020/11/02 by Beliz Gunel, Jingfei Du, Gunel, Beliz +5 · 15 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Answering Complex Open-Domain Questions with Multi-Hop Dense Retrieval
2020/09/27 by Xiong, Wenhan, Li, Xiang Lorraine, Iyer, Srini +8 · 12 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Few-shot Learning with Multilingual Language Models
2021/12/20 by Xi Victoria Lin, Todor Mihaylov, Lin, Xi Victoria +39 · 11 citations
Computer Science · #Topic Modeling #Hate Speech and Cyberbullying Detection #Natural Language Processing Techniques
- Improving In-Context Few-Shot Learning via Self-Supervised Training
2022/05/03 by Mingda Chen, Chen, Mingda, Jingfei Du +11 · 5 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Topic Modeling #Multimodal Machine Learning Applications
- Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model
2019/12/19 by Wenhan Xiong, Jingfei Du, Xiong, Wenhan +5 · 6 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality
2023/05/23 by Harman Preet Singh, Pengchuan Zhang, Singh, Harman +11 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Speech-to-Speech Translation For A Real-world Unwritten Language
2022/11/11 by Peng‐Jen Chen, Kevin Tran, Chen, Peng-Jen +29 · 3 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #Topic Modeling #electronic engineering #information engineering
- Self-training Improves Pre-training for Natural Language Understanding
2020/10/05 by Jingfei Du, Édouard Grave, Du, Jingfei +13 · 2 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Larger-Scale Transformers for Multilingual Masked Language Modeling
2021/05/02 by Goyal, Naman, Du, Jingfei, Ott, Myle +2 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations
2022/11/08 by Duquenne, Paul-Ambroise, Gong, Hongyu, Dong, Ning +7 · 1 citation
#Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering