Sun, Simeng
- RULER: What's the Real Context Size of Your Long-Context Language Models?
2024/04/09 by Cheng-Ping Hsieh, Simeng Sun, Hsieh, Cheng-Ping +11 · 191 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech and dialogue systems
- nGPT: Normalized Transformer with Representation Learning on the Hypersphere
2024/10/01 by Ilya Loshchilov, Cheng-Ping Hsieh, Loshchilov, Ilya +5 · 4 voices · 18 citations
#cs.LG #cs.AI
- PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents
2023/05/23 by Simeng Sun, Sun, Simeng, Yang Liu +7 · 1 voice · 9 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling #cs.CL
- Do Long-Range Language Models Actually Use Long-Range Context?
2021/09/19 by Sun, Simeng, Krishna, Kalpesh, Mattarella-Micke, Andrew +1 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Image Coding for Machines with Omnipotent Feature Learning
2022/07/05 by Feng, Ruoyu, Jin, Xin, Guo, Zongyu +6 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Hard-Coded Gaussian Attention for Neural Machine Translation
2020/05/02 by Weiqiu You, You, Weiqiu, Simeng Sun +3 · 4 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
- Suri: Multi-constraint Instruction Following for Long-form Text Generation
2024/06/27 by Chau Minh Pham, Chau Pham, Simeng Sun +4 · 1 voice · 2 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech and dialogue systems
- SWAN-GPT: An Efficient and Scalable Approach for Long-Context Language Modeling
2025/04/11 by Krishna C. Puvvada, Puvvada, Krishna C., Faisal Ladhak +19 · 6 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- IGA : An Intent-Guided Authoring Assistant
2021/04/14 by Sun, Simeng, Zhao, Wenlong, Manjunatha, Varun +5 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- NVIDIA Nemotron 3: Efficient and Open Intelligence
2025/12/24 by NVIDIA, :, Blakeman, Aaron +356 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
2025/12/23 by NVIDIA, :, Aaron Blakeman +623 · 1 voice · 2 citations
#cs.CL #cs.AI #cs.LG
- Efficiently Upgrading Multilingual Machine Translation Models to Support More Languages
2023/02/07 by Simeng Sun, Sun, Simeng, Maha Elbayad +5 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Exploring the impact of low-rank adaptation on the performance, efficiency, and regularization of RLHF
2023/09/16 by Sun, Simeng, Gupta, Dhawal, Iyyer, Mohit · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- L0-Reasoning Bench: Evaluating Procedural Correctness in Language Models via Simple Program Execution
2025/03/28 by Simeng Sun, Sun, Simeng, Cheng-Ping Hsieh +8 · 3 citations
Computer Science · #Software Testing and Debugging Techniques #Software Engineering Research #Software System Performance and Reliability