vix.ing · top · new · best · stats · spec

Pengcheng He

  1. DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
    2023/09/07 by Yung-Sung Chuang, Chuang, Yung-Sung, Yujia Xie +9 · 3 voices · 97 citations
    Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.AI #cs.CL #cs.LG
  2. Instruction Tuning with GPT-4
    2023/04/06 by Baolin Peng, Peng, Baolin, Chunyuan Li +7 · 3 voices · 68 citations
    Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
  3. DeBERTa: Decoding-enhanced BERT with Disentangled Attention
    2020/06/05 by Pengcheng He, He, Pengcheng, Xiaodong Liu +5 · 334 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  4. DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing
    2021/11/18 by Pengcheng He, He, Pengcheng, Jianfeng Gao +3 · 236 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2 #I.7 #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL #cs.GL
  5. Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback
    2023/02/24 by Baolin Peng, Peng, Baolin, Michel Galley +21 · 2 voices · 39 citations
    Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
  6. AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning
    2023/03/18 by Qingru Zhang, Minshuo Chen, Zhang, Qingru +12 · 172 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  7. Multi-Task Deep Neural Networks for Natural Language Understanding
    2019/01/31 by Xiaodong Liu, Liu, Xiaodong, Pengcheng He +5 · 1 voice · 55 citations
    Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.CL
  8. On the Variance of the Adaptive Learning Rate and Beyond
    2019/08/08 by Liyuan Liu, Haoming Jiang, Liu, Liyuan +11 · 99 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Stochastic Gradient Optimization Techniques
  9. Query Rewriting for Retrieval-Augmented Large Language Models
    2023/05/23 by Xinbei Ma, Yeyun Gong, Ma, Xinbei +7 · 48 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  10. Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Models
    2023/04/25 by Zhendong Wang, Yifan Jiang, Wang, Zhendong +13 · 38 citations
    Computer Science · Medicine · #Advanced Neuroimaging Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Radiomics and Machine Learning in Medical Imaging
  11. Diffusion-GAN: Training GANs with Diffusion
    2022/06/05 by Zhendong Wang, Huangjie Zheng, Wang, Zhendong +7 · 29 citations
    Computer Science · #AI in cancer detection #Digital Media Forensic Detection #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  12. LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models
    2023/10/12 by Yixiao Li, Li, Yixiao, Yifan Yu +11 · 33 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
  13. Generation-Augmented Retrieval for Open-domain Question Answering
    2020/09/17 by Yuning Mao, Pengcheng He, Mao, Yuning +11 · 18 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  14. LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation
    2023/06/20 by Yixiao Li, Li, Yixiao, Yifan Yu +11 · 20 citations
    Computer Science · Mathematics · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Tensor decomposition and applications #Topic Modeling
  15. Less is More: Task-aware Layer-wise Distillation for Language Model Compression
    2022/10/04 by Liang Chen, Liang, Chen, Simiao Zuo +9 · 14 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  16. Guiding Large Language Models via Directional Stimulus Prompting
    2023/02/22 by Zekun Li, Baolin Peng, Li, Zekun +9 · 15 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  17. Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding
    2019/04/20 by Xiaodong Liu, Pengcheng He, Liu, Xiaodong +5 · 18 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  18. Adversarial Training for Large Neural Language Models
    2020/04/20 by Xiaodong Liu, Hao Cheng, Liu, Xiaodong +11 · 12 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  19. Evaluating the Instruction-Following Robustness of Large Language Models to Prompt Injection
    2023/08/17 by Zekun Li, Li, Zekun, Baolin Peng +5 · 13 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Software Engineering Research #Topic Modeling
  20. PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance
    2022/06/25 by Qingru Zhang, Simiao Zuo, Zhang, Qingru +11 · 8 citations
    Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  21. HyperTuning: Toward Adapting Large Language Models without Back-propagation
    2022/11/22 by Jason Phang, Yi Mao, Phang, Jason +5 · 8 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  22. POUF: Prompt-oriented unsupervised fine-tuning for large pre-trained models
    2023/04/29 by Korawat Tanwisuth, Tanwisuth, Korawat, Shujian Zhang +7 · 9 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  23. OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering
    2022/07/08 by Zhengbao Jiang, Jiang, Zhengbao, Yi Mao +7 · 4 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling #Web Data Mining and Analysis
  24. MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation
    2022/04/15 by Simiao Zuo, Zuo, Simiao, Qingru Zhang +9 · 3 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  25. Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective
    2023/10/17 by Ming Zhong, Chenxin An, Zhong, Ming +7 · 4 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
  26. Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization
    2021/05/25 by Liang Chen, Liang, Chen, Simiao Zuo +13 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  27. GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
    2022/06/22 by Baolin Peng, Peng, Baolin, Michel Galley +15 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
  28. Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modeling
    2023/10/10 by Huangjie Zheng, Zhendong Wang, Zheng, Huangjie +13 · 3 citations
    Computer Science · Medicine · #Advanced Neuroimaging Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  29. Summarization with Precise Length Control
    2023/05/09 by Lesly Miculicich, Yujia Xie, Miculicich, Lesly +5 · 2 citations
    Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  30. Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach
    2021/04/11 by Simiao Zuo, Liang Chen, Zuo, Simiao +13 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
  31. Token-wise Curriculum Learning for Neural Machine Translation
    2021/03/20 by Liang Chen, Haoming Jiang, Liang, Chen +11 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  32. No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models
    2022/02/06 by Liang Chen, Liang, Chen, Haoming Jiang +13 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling