vix.ing · top · new · best · stats · spec

Yikang Shen

  1. Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision
    2023/05/04 by Zhiqing Sun, Sun, Zhiqing, Yikang Shen +13 · 2 voices · 19 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.CY #cs.LG
  2. Aligning Large Multimodal Models with Factually Augmented RLHF
    2023/09/25 by Zhiqing Sun, Sun, Zhiqing, Sheng Shen +21 · 107 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Text Readability and Simplification #Topic Modeling
  3. Gated Linear Attention Transformers with Hardware-Efficient Training
    2023/12/11 by Yang Song-lin, Bailin Wang, Yang, Songlin +7 · 77 citations
    Computer Science · Engineering · #Neural Networks and Applications #Advanced Memory and Neural Computing #CCD and CMOS Imaging Sensors
  4. Long Range Arena: A Benchmark for Efficient Transformers
    2020/11/08 by Yi Tay, Mostafa Dehghani, Tay, Yi +17 · 50 citations
    Computer Science · Engineering · #Advanced Neural Network Applications #Ferroelectric and Negative Capacitance Devices #Power Line Inspection Robots
  5. Parallelizing Linear Transformers with the Delta Rule over Sequence Length
    2024/06/10 by Songlin Yang, Bailin Wang, Yang, Songlin +7 · 61 citations
    Computer Science · #Cellular Automata and Applications #Computability, Logic, AI Algorithms #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Quantum Computing Algorithms and Architecture
  6. Planning with Large Language Models for Code Generation
    2023/03/09 by Shun Zhang, Zhang, Shun, Zhenfang Chen +9 · 25 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Programming Languages (cs.PL) #Software Engineering Research #Software Testing and Debugging Techniques
  7. Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training
    2024/05/24 by Wenyu Du, Du, Wenyu, Tongxu Luo +13 · 14 citations
    Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences
  8. Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
    2024/03/14 by Zhiqing Sun, Longhui Yu, Sun, Zhiqing +11 · 12 citations
    Computer Science · #Image Retrieval and Classification Techniques
  9. Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks
    2018/10/22 by Yikang Shen, Shen, Yikang, Shawn W. Tan +6 · 5 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
  10. See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning
    2023/01/12 by Zhenfang Chen, Qinhong Zhou, Chen, Zhenfang +9 · 7 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
  11. JetMoE: Reaching Llama2 Performance with 0.1M Dollars
    2024/04/11 by Yikang Shen, Zhen Guo, Shen, Yikang +5 · 9 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  12. Adaptive Online Replanning with Diffusion Models
    2023/10/14 by Siyuan Zhou, Zhou, Siyuan, Yilun Du +13 · 6 citations
    Computer Science · #Artificial Intelligence in Games #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Robotic Path Planning Algorithms #Robotics (cs.RO)
  13. The Consensus Game: Language Model Generation via Equilibrium Search
    2023/10/13 by Athul Paul Jacob, Yikang Shen, Jacob, Athul Paul +5 · 5 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Science and Game Theory (cs.GT) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  14. PaTH Attention: Position Encoding via Accumulating Householder Transformations
    2025/05/22 by Songlin Yang, Yikang Shen, Yang, Songlin +12 · 12 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  15. Diversity Measurement and Subset Selection for Instruction Tuning Datasets
    2024/02/04 by Peiqi Wang, Yikang Shen, Wang, Peiqi +11 · 5 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Online Learning and Analytics
  16. Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler
    2024/08/23 by Yikang Shen, Shen, Yikang, Matthew Stallone +15 · 6 citations
    Engineering · Computer Science · #Low-power high-performance VLSI design #VLSI and Analog Circuit Testing #Experimental Learning in Engineering
  17. ModuleFormer: Modularity Emerges from Mixture-of-Experts
    2023/06/07 by Yikang Shen, Zheyu Zhang, Shen, Yikang +9 · 3 citations
    Computer Science · Medicine · #Topic Modeling #Domain Adaptation and Few-Shot Learning #COVID-19 diagnosis using AI
  18. Scaling Stick-Breaking Attention: An Efficient Implementation and In-depth Study
    2024/10/23 by Shawn Tan, Tan, Shawn, Yang Song-lin +7 · 4 citations
    Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
  19. Dense Training, Sparse Inference: Rethinking Training of Mixture-of-Experts Language Models
    2024/04/08 by Bowen Pan, Pan, Bowen, Yikang Shen +13 · 3 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning in Healthcare
  20. Hyper-Decision Transformer for Efficient Online Policy Adaptation
    2023/04/17 by Mengdi Xu, Yuchen Lu, Xu, Mengdi +9 · 2 citations
    Computer Science · #Reinforcement Learning in Robotics #Adversarial Robustness in Machine Learning #Machine Learning and Data Classification
  21. Scaling Granite Code Models to 128K Context
    2024/07/18 by Matt Stallone, Vaibhav Saxena, Stallone, Matt +41 · 3 citations
    Engineering · Materials Science · #Advanced Surface Polishing Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #High-Velocity Impact and Material Behavior #Metallurgy and Material Forming #Software Engineering (cs.SE)
  22. BanditSum: Extractive Summarization as a Contextual Bandit
    2018/09/25 by Yue Dong, Yikang Shen, Dong, Yue +7 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  23. Octo-planner: On-device Language Model for Planner-Action Agents
    2024/06/26 by Wei Chen, Zhiyuan Li, Chen, Wei +5 · 3 citations
    Computer Science · #Multi-Agent Systems and Negotiation #Semantic Web and Ontologies #AI-based Problem Solving and Planning
  24. Efficient Continual Pre-training by Mitigating the Stability Gap
    2024/06/21 by Yiduo Guo, Jie Fu, Guo, Yiduo +7 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning
  25. API Pack: A Massive Multi-Programming Language Dataset for API Call Generation
    2024/02/14 by Zhen Guo, Guo, Zhen, Adriana Meza Soria +7 · 2 citations
    Computer Science · #Advanced Software Engineering Methodologies #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Service-Oriented Architecture and Web Services #Web Data Mining and Analysis
  26. The infrastructure powering IBM's Gen AI model development
    2024/07/07 by Talia Gershon, Seetharami Seelam, Gershon, Talia +241 · 2 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Digital Transformation in Industry #Distributed #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Parallel #Robotics and Automated Systems #and Cluster Computing (cs.DC)
  27. Visual Dependency Transformers: Dependency Tree Emerges from Reversed Attention
    2023/04/06 by Mingyu Ding, Ding, Mingyu, Yikang Shen +13 · 1 citation
    Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Visual Attention and Saliency Detection
  28. Scattered Mixture-of-Experts Implementation
    2024/03/13 by Shawn Tan, Tan, Shawn, Yikang Shen +5 · 1 citation
    Earth and Planetary Sciences · #Environmental Monitoring and Data Management