Fu, Yao
- DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
2024/10/14 by Guangxuan Xiao, Jiaming Tang, Xiao, Guangxuan +14 · 1 voice · 59 citations
Computer Science · #Time Series Analysis and Forecasting #Data Stream Mining Techniques #Neural Networks and Applications
- C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models
2023/05/15 by Yuzhen Huang, Yuzhuo Bai, Huang, Yuzhen +23 · 105 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- Decomposed Prompting: A Modular Approach for Solving Complex Tasks
2022/10/05 by Tushar Khot, Harsh Trivedi, Khot, Tushar +11 · 83 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning
2023/09/11 by Yue, Xiang, Qu, Xingwei, Zhang, Ge +5 · 63 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Complexity-Based Prompting for Multi-Step Reasoning
2022/10/03 by Yao Fu, Hao Peng, Fu, Yao +7 · 40 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- Specializing Smaller Language Models towards Multi-Step Reasoning
2023/01/30 by Yao Fu, Fu, Yao, Hao Peng +7 · 28 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
- OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models
2024/01/29 by Xue, Fuzhao, Zheng, Zian, Fu, Yao +4 · 33 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Training Foundation Models on a Full-Stack AMD Platform: Compute, Networking, and System Design
2025/11/21 by Quentin Anthony, Anthony, Quentin, Yury Tokpanov +39 · 3 voices · 1 citation
#cs.CL #cs.AI #cs.DC
- Retrieval Head Mechanistically Explains Long-Context Factuality
2024/04/24 by Wenhao Wu, Wu, Wenhao, Yizhong Wang +7 · 33 citations
Computer Science · Neuroscience · #Topic Modeling #Memory Processes and Influences
- ServerlessLLM: Low-Latency Serverless Inference for Large Language Models
2024/01/25 by Yao Fu, Fu, Yao, Leyang Xue +11 · 28 citations
Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #Topic Modeling #and Cluster Computing (cs.DC)
- Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedback
2023/05/17 by Yao Fu, Hao Peng, Fu, Yao +5 · 20 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
- Toward Inference-optimal Mixture-of-Expert Large Language Models
2024/04/03 by Longfei Yun, Yun, Longfei, Yonghao Zhuang +8 · 1 voice · 2 citations
Computer Science · #Topic Modeling #Machine Learning in Healthcare
- AutoGuide: Automated Generation and Selection of Context-Aware Guidelines for Large Language Model Agents
2024/03/13 by Fu, Yao, Kim, Dong-Ki, Kim, Jaekyeom +4 · 16 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Data Engineering for Scaling Language Models to 128K Context
2024/02/15 by Yao Fu, Rameswar Panda, Fu, Yao +11 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Network Packet Processing and Optimization #Parallel Computing and Optimization Techniques
- To Repeat or Not To Repeat: Insights from Scaling LLM under Token-Crisis
2023/05/22 by Fuzhao Xue, Xue, Fuzhao, Yao Fu +7 · 10 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- MoE-Infinity: Efficient MoE Inference on Personal Machines with Sparsity-Aware Expert Cache
2024/01/25 by Leyang Xue, Yao Fu, Xue, Leyang +7 · 7 citations
Computer Science · #Privacy-Preserving Technologies in Data #IoT and Edge/Fog Computing #Context-Aware Activity Recognition Systems
- TorchOpt: An Efficient Library for Differentiable Optimization
2022/11/13 by Ren, Jie, Feng, Xidong, Liu, Bo +4 · 5 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Mathematical Software (cs.MS) #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC)
- Challenges in Deploying Long-Context Transformers: A Theoretical Peak Performance Analysis
2024/05/14 by Yao Fu, Fu, Yao · 7 citations
Computer Science · #Parallel Computing and Optimization Techniques
- Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance
2023/05/26 by Yao Fu, Litu Ou, Fu, Yao +9 · 5 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Explainable Artificial Intelligence (XAI)
- Probing BERT in Hyperbolic Spaces
2021/04/08 by Boli Chen, Chen, Boli, Yao Fu +11 · 3 citations
Computer Science · #Authorship Attribution and Profiling #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Optical read and write of spin states in organic diradicals
2024/06/05 by Rituparno Chowdhury, Chowdhury, Rituparno, Petri Murto +37 · 5 citations
Materials Science · Physics and Astronomy · #Diamond and Carbon-based Materials Research #Quantum and electron transport phenomena #Cold Atom Physics and Bose-Einstein Condensates
- Critical Data Size of Language Models from a Grokking Perspective
2024/01/19 by Zhu, Xuekai, Fu, Yao, Zhou, Bowen +1 · 3 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Improving ResBos for the precision needs of the LHC
2023/11/16 by Isaacson, Joshua, Fu, Yao, Yuan, C. -P. · 3 citations
#FOS: Physical sciences #High Energy Physics - Experiment (hep-ex) #High Energy Physics - Phenomenology (hep-ph)
- Long Context Alignment with Short Instructions and Synthesized Positions
2024/05/07 by Wu, Wenhao, Wang, Yizhong, Fu, Yao +3 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- ResBos2 and the CDF W Mass Measurement
2022/05/05 by Isaacson, Joshua, Fu, Yao, Yuan, C. -P. · 2 citations
#FOS: Physical sciences #High Energy Physics - Experiment (hep-ex) #High Energy Physics - Phenomenology (hep-ph)
- Data-to-text Generation with Variational Sequential Planning
2022/02/28 by Puduppully, Ratish, Fu, Yao, Lapata, Mirella · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Repeater-like asynchronous measurement-device-independent quantum conference key agreement
2024/06/22 by Lu, Yu-Shuo, Yin, Hua-Lei, Xie, Yuan-Mei +2 · 2 citations
#FOS: Physical sciences #Quantum Physics (quant-ph)
- Interactive and Expressive Code-Augmented Planning with Large Language Models
2024/11/21 by Liu, Anthony Z., Wang, Xinhe, Sansom, Jacob +5 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Probing Parton distribution functions at large x via Drell-Yan Forward-Backward Asymmetry
2023/07/15 by Fu, Yao, Brock, Raymond, Hayden, Daniel +1 · 1 citation
#FOS: Physical sciences #High Energy Physics - Experiment (hep-ex) #High Energy Physics - Phenomenology (hep-ph)
- MoE-CAP: Benchmarking Cost, Accuracy and Performance of Sparse Mixture-of-Experts Systems
2025/05/16 by Jiang, Yinsicheng, Fu, Yao, Huang, Yeqi +13 · 2 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Hierarchical search method for gravitational waves from stellar-mass binary black holes in noisy space-based detector data
2024/07/15 by Yao Fu, Fu, Yao, Yan Wang +3 · 1 citation
Earth and Planetary Sciences · Physics and Astronomy · #Cosmology and Gravitation Theories #FOS: Physical sciences #General Relativity and Quantum Cosmology (gr-qc) #Geophysics and Gravity Measurements #High Energy Astrophysical Phenomena (astro-ph.HE) #Instrumentation and Methods for Astrophysics (astro-ph.IM) #Pulsars and Gravitational Waves Research
- Quantized but Deceptive? A Multi-Dimensional Truthfulness Evaluation of Quantized LLMs
2025/08/26 by Fu, Yao, Long, Xianxuan, Li, Runchao +5 · 4 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences