Wenhui Wang
- The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
2024/02/27 by Shuming Ma, Ma, Shuming, Hongyu Wang +17 · 24 voices · 47 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- LongNet: Scaling Transformers to 1,000,000,000 Tokens
2023/07/05 by Jiayu Ding, Shuming Ma, Ding, Jiayu +13 · 7 voices · 25 citations
Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL #cs.LG
- Language Is Not All You Need: Aligning Perception with Language Models
2023/02/27 by Shaohan Huang, Li Dong, Huang, Shaohan +35 · 1 voice · 41 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Kosmos-2: Grounding Multimodal Large Language Models to the World
2023/06/26 by Zhiliang Peng, Peng, Zhiliang, Wenhui Wang +11 · 1 voice · 130 citations
Computer Science · #cs.CL #cs.CV
- MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
2020/02/25 by Wenhui Wang, Wang, Wenhui, Furu Wei +9 · 215 citations
Computer Science · Engineering · Materials Science · #Topic Modeling #Ferroelectric and Negative Capacitance Devices #Machine Learning in Materials Science
- You Only Cache Once: Decoder-Decoder Architectures for Language Models
2024/05/08 by Yutao Sun, Sun, Yutao, Li Dong +15 · 2 voices · 20 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
- VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts
2021/11/03 by Hangbo Bao, Wenhui Wang, Bao, Hangbo +9 · 33 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks
2022/08/22 by Wenhui Wang, Hangbo Bao, Wang, Wenhui +19 · 24 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training
2020/07/15 by Zewen Chi, Chi, Zewen, Li Dong +16 · 19 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Comparing SNNs and RNNs on Neuromorphic Vision Datasets: Similarities and Differences
2020/05/02 by Weihua He, Yujie Wu, He, Weihua +15 · 4 citations
Engineering · Neuroscience · #Advanced Memory and Neural Computing #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Ferroelectric and Negative Capacitance Devices #Image and Video Processing (eess.IV) #Neural and Evolutionary Computing (cs.NE) #Neural dynamics and brain function #electronic engineering #information engineering
- Multi-Head Mixture-of-Experts
2024/04/23 by Xun Wu, Shaohan Huang, Wu, Xun +5 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Speech and dialogue systems
- Multimodal Latent Language Modeling with Next-Token Diffusion
2024/12/11 by Yutao Sun, Sun, Yutao, Hangbo Bao +13 · 9 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech and dialogue systems
- Cross-Lingual Natural Language Generation via Pre-Training
2019/09/23 by Zewen Chi, Chi, Zewen, Dong Li +9 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Learning to Ask Unanswerable Questions for Machine Reading Comprehension
2019/06/14 by Haichao Zhu, Li Dong, Zhu, Haichao +9 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Single-shot deterministic complex amplitude imaging with a single-layer metalens
2023/09/28 by Liu Li, Li, Liu, Shuai Wang +17 · 2 citations
Computer Science · Engineering · Physics and Astronomy · #Digital Holography and Microscopy #FOS: Physical sciences #Optical Polarization and Ellipsometry #Optical measurement and interference techniques #Optics (physics.optics)
- When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology
2023/12/06 by Wenhui Wang, Shuming Ma, Wang, Wenhui +11 · 1 citation
Computer Science · Medicine · #AI in cancer detection #Colorectal Cancer Screening and Detection #Computer Vision and Pattern Recognition (cs.CV) #Digital Imaging for Blood Diseases #FOS: Computer and information sciences
- RedStone: Curating General, Code, Math, and QA Data for Large Language Models
2024/12/04 by Yaoyao Chang, Chang, Yaoyao, Lei Cui +29 · 1 citation
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- VibeVoice-ASR-BitNet Technical Report
2026/07/23 by Songchen Xu, Ting Song, Shaohan Huang +10
#cs.SD #cs.CL #eess.AS