Simeng Sun
- RULER: What's the Real Context Size of Your Long-Context Language Models?
2024/04/09 by Cheng-Ping Hsieh, Hsieh, Cheng-Ping, Simeng Sun +11 · 198 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech and dialogue systems
- nGPT: Normalized Transformer with Representation Learning on the Hypersphere
2024/10/01 by Ilya Loshchilov, Cheng-Ping Hsieh, Loshchilov, Ilya +5 · 4 voices · 19 citations
#cs.LG #cs.AI
- PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents
2023/05/23 by Simeng Sun, Yang Liu, Sun, Simeng +7 · 1 voice · 9 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling #cs.CL
- Hard-Coded Gaussian Attention for Neural Machine Translation
2020/05/02 by Weiqiu You, You, Weiqiu, Simeng Sun +3 · 4 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
- Suri: Multi-constraint Instruction Following for Long-form Text Generation
2024/06/27 by Chau Pham, Chau Minh Pham, Simeng Sun +4 · 1 voice · 2 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech and dialogue systems
- SWAN-GPT: An Efficient and Scalable Approach for Long-Context Language Modeling
2025/04/11 by Krishna C. Puvvada, Puvvada, Krishna C., Faisal Ladhak +19 · 6 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
2025/12/23 by NVIDIA, Aaron Blakeman, : +623 · 1 voice · 2 citations
#cs.CL #cs.AI #cs.LG
- Efficiently Upgrading Multilingual Machine Translation Models to Support More Languages
2023/02/07 by Simeng Sun, Maha Elbayad, Sun, Simeng +5 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- L0-Reasoning Bench: Evaluating Procedural Correctness in Language Models via Simple Program Execution
2025/03/28 by Simeng Sun, Sun, Simeng, Cheng-Ping Hsieh +8 · 3 citations
Computer Science · #Software Testing and Debugging Techniques #Software Engineering Research #Software System Performance and Reliability