vix.ing · top · new · best · stats · spec

Shaohan Huang

  1. Retentive Network: A Successor to Transformer for Large Language Models
    2023/07/17 by Yutao Sun, Sun, Yutao, Li Dong +13 · 8 voices · 109 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  2. The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
    2024/02/27 by Shuming Ma, Ma, Shuming, Hongyu Wang +17 · 24 voices · 51 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
  3. LongNet: Scaling Transformers to 1,000,000,000 Tokens
    2023/07/05 by Jiayu Ding, Shuming Ma, Ding, Jiayu +13 · 7 voices · 28 citations
    Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL #cs.LG
  4. Language Is Not All You Need: Aligning Perception with Language Models
    2023/02/27 by Shaohan Huang, Huang, Shaohan, Li Dong +35 · 1 voice · 46 citations
    Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
  5. BitNet: Scaling 1-bit Transformers for Large Language Models
    2023/10/17 by Hongyu Wang, Wang, Hongyu, Shuming Ma +18 · 8 voices · 42 citations
    Computer Science · #Multimodal Machine Learning Applications #Speech Recognition and Synthesis #Topic Modeling #cs.CL
  6. DeepNet: Scaling Transformers to 1,000 Layers
    2022/03/01 by Hongyu Wang, Shuming Ma, Wang, Hongyu +10 · 2 voices · 18 citations
    Computer Science · Engineering · #Neural Networks and Reservoir Computing #Ferroelectric and Negative Capacitance Devices #Advanced Neural Network Applications
  7. Kosmos-2: Grounding Multimodal Large Language Models to the World
    2023/06/26 by Zhiliang Peng, Wenhui Wang, Peng, Zhiliang +11 · 1 voice · 142 citations
    Computer Science · #cs.CL #cs.CV
  8. BitNet b1.58 2B4T Technical Report
    2025/04/16 by Shuming Ma, Ma, Shuming, Hongyu Wang +14 · 10 voices · 13 citations
    Computer Science · #Advanced Neural Network Applications #Big Data and Digital Economy #Natural Language Processing Techniques #cs.CL #cs.LG
  9. You Only Cache Once: Decoder-Decoder Architectures for Language Models
    2024/05/08 by Yutao Sun, Li Dong, Sun, Yutao +15 · 2 voices · 27 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
  10. Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
    2024/02/20 by Haoran Li, Qingxiu Dong, Li, Haoran +40 · 1 voice · 15 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL
  11. Mixture of LoRA Experts
    2024/04/21 by Xun Wu, Shaohan Huang, Wu, Xun +3 · 41 citations
    Computer Science · #Anomaly Detection Techniques and Applications #Computation and Language (cs.CL) #Context-Aware Activity Recognition Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Multimedia (cs.MM)
  12. Adapting Large Language Models to Domains via Reading Comprehension
    2023/09/18 by Daixuan Cheng, Cheng, Daixuan, Shaohan Huang +3 · 27 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
  13. Reasoning with Exploration: An Entropy Perspective
    2025/06/17 by Shaohan Huang, Cheng, Daixuan, Huang, Shaohan +9 · 108 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
  14. MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
    2024/05/20 by Ting Jiang, Shaohan Huang, Jiang, Ting +20 · 2 voices · 3 citations
    Computer Science · Engineering · #Advanced Data Compression Techniques #Advanced SAR Imaging Techniques #Blind Source Separation Techniques #cs.CL #cs.LG
  15. Kosmos-G: Generating Images in Context with Multimodal Large Language Models
    2023/10/04 by Xichen Pan, Pan, Xichen, Li Dong +9 · 20 citations
    Social Sciences · Computer Science · #Computational and Text Analysis Methods #Multimodal Machine Learning Applications #Topic Modeling
  16. On the Representation Collapse of Sparse Mixture of Experts
    2022/04/20 by Zewen Chi, Dong Li, Chi, Zewen +17 · 14 citations
    Computer Science · #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
  17. A Length-Extrapolatable Transformer
    2022/12/20 by Yutao Sun, Dong Li, Sun, Yutao +14 · 14 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
  18. LogGPT: Exploring ChatGPT for Log-Based Anomaly Detection
    2023/09/03 by Jiaxing Qi, Shaohan Huang, Qi, Jiaxing +9 · 14 citations
    Computer Science · Decision Sciences · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Data Quality and Management #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE) #Software System Performance and Reliability
  19. Instruction Pre-Training: Language Models are Supervised Multitask Learners
    2024/06/20 by Daixuan Cheng, Yuxian Gu, Cheng, Daixuan +9 · 18 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
  20. Scaling Sentence Embeddings with Large Language Models
    2023/07/31 by Ting Jiang, Jiang, Ting, Shaohan Huang +7 · 12 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  21. Task-Specific Expert Pruning for Sparse Mixture-of-Experts
    2022/06/01 by Tianyu Chen, Shaohan Huang, Chen, Tianyu +13 · 8 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #Indoor and Outdoor Localization Technologies #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing
  22. UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation
    2023/03/15 by Daixuan Cheng, Shaohan Huang, Cheng, Daixuan +17 · 8 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  23. PromptBERT: Improving BERT Sentence Embeddings with Prompts
    2022/01/12 by Ting Jiang, Jiang, Ting, Jiao, Jian +15 · 6 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Sentiment Analysis and Opinion Mining
  24. Multi-Head Mixture-of-Experts
    2024/04/23 by Xun Wu, Wu, Xun, Shaohan Huang +5 · 9 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Speech and dialogue systems
  25. Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains
    2021/06/25 by Yunzhi Yao, Shaohan Huang, Yao, Yunzhi +7 · 4 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning in Healthcare #Natural Language Processing Techniques #Topic Modeling
  26. Multimodal Latent Language Modeling with Next-Token Diffusion
    2024/12/11 by Yutao Sun, Sun, Yutao, Hangbo Bao +13 · 11 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech and dialogue systems
  27. Think Only When You Need with Large Hybrid-Reasoning Models
    2025/05/20 by Lingjie Jiang, X. J. Wu, Jiang, Lingjie +17 · 24 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Semantic Web and Ontologies
  28. Context-DPO: Aligning Language Models for Context-Faithfulness
    2024/12/18 by Baolong Bi, Bi, Baolong, Shaohan Huang +25 · 10 citations
    Social Sciences · #Religion, Spirituality, and Psychology
  29. HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition
    2024/02/24 by Yuxuan Liu, Tianchi Yang, Liu, Yuxuan +15 · 5 citations
    Computer Science · #Topic Modeling #Machine Learning in Healthcare #Explainable Artificial Intelligence (XAI)
  30. Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment
    2021/06/11 by Zewen Chi, Chi, Zewen, Li Dong +11 · 3 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  31. Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training
    2021/09/15 by Bo Zheng, Zheng, Bo, Li Dong +12 · 3 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  32. Reward Reasoning Model
    2025/05/20 by Jiaxin Guo, Zewen Chi, Guo, Jiaxin +11 · 15 citations
    Social Sciences · #Computation and Language (cs.CL) #Education and Professional Development #FOS: Computer and information sciences
  33. On-Policy RL with Optimal Reward Baseline
    2025/05/29 by Yaru Hao, Dong Li, Hao, Yaru +9 · 9 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Topic Modeling
  34. Language Models are General-Purpose Interfaces
    2022/06/13 by Yaru Hao, Hao, Yaru, Haoyu Song +13 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  35. The Era of Agentic Organization: Learning to Organize with Language Models
    2025/10/30 by Zewen Chi, Chi, Zewen, Li Dong +11 · 6 voices
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.AI #cs.CL
  36. Neural Melody Composition from Lyrics
    2018/09/12 by Hangbo Bao, Shaohan Huang, Bao, Hangbo +13 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Music Technology and Sound Studies #Music and Audio Processing #Speech Recognition and Synthesis
  37. DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders
    2021/06/25 by Shuming Ma, Ma, Shuming, Li Dong +14 · 2 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
  38. CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation
    2022/10/13 by Jian Yang, Shaohan Huang, Yang, Jian +15 · 1 citation
    Computer Science · Decision Sciences · #Computation and Language (cs.CL) #Data Quality and Management #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  39. GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator
    2022/12/20 by Jian Yang, Yang, Jian, Shuming Ma +17 · 1 citation
    Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
  40. On Domain-Adaptive Post-Training for Multimodal Large Language Models
    2024/11/29 by Daixuan Cheng, Shaohan Huang, Cheng, Daixuan +13 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
  41. Black-Box On-Policy Distillation of Large Language Models
    2025/11/13 by Tianxiao Ye, Dong Li, Ye, Tianzhu +9 · 3 citations
    Computer Science · #Topic Modeling #Explainable Artificial Intelligence (XAI) #Multimodal Machine Learning Applications
  42. Response Generation by Context-aware Prototype Editing
    2018/06/19 by Yu Wu, Wu, Yu, Furu Wei +9 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Software Engineering Research #Software Testing and Debugging Techniques #Topic Modeling
  43. Democratizing Reasoning Ability: Tailored Learning from Large Language Model
    2023/10/20 by Zhaoyang Wang, Wang, Zhaoyang, Shaohan Huang +19 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  44. RedStone: Curating General, Code, Math, and QA Data for Large Language Models
    2024/12/04 by Yaoyao Chang, Lei Cui, Chang, Yaoyao +29 · 1 citation
    Computer Science · #Natural Language Processing Techniques #Topic Modeling
  45. LLM-as-a-Coach: Experiential Learning for Non-Verifiable Tasks
    2026/07/20 by Tianzhu Ye, Li Dong, Guanheng Chen +4 · 1 citation
    #cs.LG #cs.CL
  46. VibeVoice-ASR-BitNet Technical Report
    2026/07/23 by Songchen Xu, Ting Song, Shaohan Huang +10
    #cs.SD #cs.CL #eess.AS