Hangbo Bao
- MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
2020/02/25 by Wenhui Wang, Wang, Wenhui, Furu Wei +9 · 320 citations
Computer Science · Engineering · Materials Science · #Topic Modeling #Ferroelectric and Negative Capacitance Devices #Machine Learning in Materials Science
- BEiT: BERT Pre-Training of Image Transformers
2021/06/15 by Hangbo Bao, Bao, Hangbo, Dong Li +3 · 263 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts
2021/11/03 by Hangbo Bao, Wenhui Wang, Bao, Hangbo +9 · 57 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers
2020/12/31 by Wenhui Wang, Hangbo Bao, Wang, Wenhui +7 · 45 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers
2022/08/12 by Zhiliang Peng, Peng, Zhiliang, Dong Li +7 · 40 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis
- Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks
2022/08/22 by Wenhui Wang, Hangbo Bao, Wang, Wenhui +19 · 38 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Neural Question Generation from Text: A Preliminary Study
2017/04/06 by Qingyu Zhou, Nan Yang, Zhou, Qingyu +9 · 8 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Multimodal Latent Language Modeling with Next-Token Diffusion
2024/12/11 by Yutao Sun, Hangbo Bao, Sun, Yutao +13 · 14 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech and dialogue systems
- UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
2020/02/28 by Hangbo Bao, Bao, Hangbo, Li Dong +19 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Neural Melody Composition from Lyrics
2018/09/12 by Hangbo Bao, Shaohan Huang, Bao, Hangbo +13 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Music Technology and Sound Studies #Music and Audio Processing #Speech Recognition and Synthesis
- Attention Temperature Matters in Abstractive Summarization Distillation
2021/06/07 by Shengqiang Zhang, Zhang, Shengqiang, Xingxing Zhang +5 · 2 citations
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Corrupted Image Modeling for Self-Supervised Visual Pre-Training
2022/02/07 by Y.K. Fang, Dong Li, Fang, Yuxin +7 · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · #Cell Image Analysis Techniques #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- A Unified View of Masked Image Modeling
2022/10/19 by Zhiliang Peng, Peng, Zhiliang, Dong Li +7 · 1 citation
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications