Bao, Hangbo
- MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
2020/02/25 by Wenhui Wang, Furu Wei, Wang, Wenhui +9 · 217 citations
Computer Science · Engineering · Materials Science · #Topic Modeling #Ferroelectric and Negative Capacitance Devices #Machine Learning in Materials Science
- BEiT: BERT Pre-Training of Image Transformers
2021/06/15 by Hangbo Bao, Dong Li, Bao, Hangbo +3 · 170 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers
2020/12/31 by Wang, Wenhui, Bao, Hangbo, Huang, Shaohan +2 · 34 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts
2021/11/03 by Hangbo Bao, Wenhui Wang, Bao, Hangbo +9 · 33 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers
2022/08/12 by Zhiliang Peng, Peng, Zhiliang, Dong Li +7 · 24 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis
- Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks
2022/08/22 by Wenhui Wang, Hangbo Bao, Wang, Wenhui +19 · 25 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Neural Question Generation from Text: A Preliminary Study
2017/04/06 by Qingyu Zhou, Nan Yang, Zhou, Qingyu +9 · 5 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption
2022/06/01 by Chen, Tianyu, Bao, Hangbo, Huang, Shaohan +6 · 5 citations
#Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences
- Multimodal Latent Language Modeling with Next-Token Diffusion
2024/12/11 by Yutao Sun, Hangbo Bao, Sun, Yutao +13 · 9 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech and dialogue systems
- Attention Temperature Matters in Abstractive Summarization Distillation
2021/06/07 by Shengqiang Zhang, Xingxing Zhang, Zhang, Shengqiang +5 · 2 citations
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- VibeVoice Technical Report
2025/08/26 by Peng, Zhiliang, Yu, Jianwei, Wang, Wenhui +10 · 12 citations
#Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- Neural Melody Composition from Lyrics
2018/09/12 by Hangbo Bao, Bao, Hangbo, Shaohan Huang +13 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Music Technology and Sound Studies #Music and Audio Processing #Speech Recognition and Synthesis
- UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
2020/02/28 by Bao, Hangbo, Dong, Li, Wei, Furu +8 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Corrupted Image Modeling for Self-Supervised Visual Pre-Training
2022/02/07 by Y.K. Fang, Fang, Yuxin, Dong Li +7 · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · #Cell Image Analysis Techniques #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications