vix.ing · top · new · best · stats · spec

Zhiyuan Li

  1. Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
    2023/05/23 by Hong Liu, Liu, Hong, Zhiyuan Li +8 · 7 voices · 42 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Advanced Neural Network Applications
  2. Kimi Linear: An Expressive, Efficient Attention Architecture
    2025/10/30 by Kimi Team, Yu Zhang, Zongyu Lin +116 · 10 voices · 23 citations
    #cs.CL #cs.LG
  3. Chain of Thought Empowers Transformers to Solve Inherently Serial Problems
    2024/02/20 by Zhiyuan Li, Li, Zhiyuan, Hong Liu +5 · 8 voices · 63 citations
    #cs.LG #cs.CC #stat.ML
  4. Octopus v2: On-device language model for super agent
    2024/04/02 by Wei Chen, Zhiyuan Li, Chen, Wei +1 · 3 voices · 11 citations
    Computer Science · Engineering · #Multi-Agent Systems and Negotiation #Robotics and Automated Systems #Speech and dialogue systems #cs.CL
  5. Fine-Grained Analysis of Optimization and Generalization for\n Overparameterized Two-Layer Neural Networks
    2019/01/24 by Sanjeev Arora, Simon S. Du, Arora, Sanjeev +7 · 72 citations
    Computer Science · #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques #Machine Learning and ELM
  6. On Exact Computation with an Infinitely Wide Neural Net
    2019/04/26 by Sanjeev Arora, Simon S. Du, Arora, Sanjeev +9 · 32 citations
    Computer Science · #Gaussian Processes and Bayesian Inference #Stochastic Gradient Optimization Techniques #Advanced Neural Network Applications
  7. An Exponential Learning Rate Schedule for Deep Learning
    2019/10/16 by Zhiyuan Li, Sanjeev Arora, Li, Zhiyuan +1 · 30 citations
    Computer Science · #Advanced Neural Network Applications #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
  8. On-Device Language Models: A Comprehensive Review
    2024/08/26 by Jiajun Xu, Zhiyuan Li, Xu, Jiajun +11 · 37 citations
    Computer Science · Engineering · #Computation and Language (cs.CL) #Context-Aware Activity Recognition Systems #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Smart Cities and Technologies
  9. Reasoning with Latent Thoughts: On the Power of Looped Transformers
    2025/02/24 by Nikunj Saunshi, Saunshi, Nikunj, Nishanth Dikkala +7 · 34 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Semantic Web and Ontologies
  10. First Indication of Solar 8B Neutrino Flux through Coherent Elastic Neutrino-Nucleus Scattering in PandaX-4T
    2024/07/15 by PandaX Collaboration, Zihao Bo, Bo, Zihao +197 · 18 citations
    Earth and Planetary Sciences · Physics and Astronomy · #Atmospheric Ozone and Climate #Geophysics and Gravity Measurements #Cosmology and Gravitation Theories
  11. Towards Resolving the Implicit Bias of Gradient Descent for Matrix Factorization: Greedy Low-Rank Learning
    2020/12/17 by Zhiyuan Li, Li, Zhiyuan, Yuping Luo +3 · 9 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  12. Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Prior
    2024/04/29 by Zhiyuan Li, Li, Zhiyuan, Yanhui Zhou +7 · 12 citations
    Computer Science · #Advanced Data Compression Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image Retrieval and Classification Techniques #Image and Signal Denoising Methods #Image and Video Processing (eess.IV) #electronic engineering #information engineering
  13. How Does Sharpness-Aware Minimization Minimize Sharpness?
    2022/11/10 by Kaiyue Wen, Wen, Kaiyue, Tengyu Ma +3 · 8 citations
    Computer Science · #Stochastic Gradient Optimization Techniques #Domain Adaptation and Few-Shot Learning #Machine Learning and ELM
  14. Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization
    2023/07/20 by Kaiyue Wen, Zhiyuan Li, Wen, Kaiyue +3 · 9 citations
    Computer Science · #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #Machine Learning and ELM
  15. What Happens after SGD Reaches Zero Loss? --A Mathematical Framework
    2021/10/13 by Zhiyuan Li, Li, Zhiyuan, Tianhao Wang +3 · 6 citations
    Computer Science · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Stochastic Gradient Optimization Techniques
  16. On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs)
    2021/02/24 by Zhiyuan Li, Li, Zhiyuan, Sadhika Malladi +3 · 7 citations
    Computer Science · #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #Machine Learning and ELM
  17. Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models
    2022/10/25 by Hong Liu, Liu, Hong, Sang Michael Xie +5 · 7 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
  18. Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective
    2024/10/07 by Kaiyue Wen, Wen, Kaiyue, Zhiyuan Li +9 · 8 citations
    Computer Science · #Machine Learning and Data Classification #Machine Learning and Algorithms #Anomaly Detection Techniques and Applications
  19. Octopus: On-device language model for function calling of software APIs
    2024/04/02 by Wei Chen, Chen, Wei, Zhiyuan Li +3 · 8 citations
    Business, Management and Accounting · Computer Science · Decision Sciences · #Business Process Modeling and Analysis #Scientific Computing and Data Management #Service-Oriented Architecture and Web Services #cs.CL #cs.SE
  20. Weak unique continuation property and a related inverse source problem for time-fractional diffusion-advection equations
    2017/03/24 by Daijun Jiang, Zhiyuan Li, Yikan Liu +1 · 2 citations
  21. Complex Organ Mask Guided Radiology Report Generation
    2023/11/04 by Gu Tiancheng, Dongnan Liu, Gu, Tiancheng +5 · 4 citations
    Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Radiomics and Machine Learning in Medical Imaging #Topic Modeling
  22. Adam Exploits ℓ_∞-geometry of Loss Landscape via Coordinate-wise Adaptivity
    2024/10/10 by Shuo Xie, Mohamad Amin Mohamadi, Xie, Shuo +3 · 6 citations
    Computer Science · Mathematics · Engineering · #Computational Geometry and Mesh Generation #Markov Chains and Monte Carlo Methods #3D Shape Modeling and Analysis
  23. Multimodal Causal Reasoning Benchmark: Challenging Vision Large Language Models to Discern Causal Links Across Modalities
    2024/08/15 by Zhiyuan Li, Li, Zhiyuan, Heng Wang +11 · 5 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  24. Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition
    2024/07/17 by Mohamad Amin Mohamadi, Mohamadi, Mohamad Amin, Zhiyuan Li +5 · 4 citations
    Computer Science · #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  25. Enhancing Advanced Visual Reasoning Ability of Large Language Models
    2024/09/21 by Zhiyuan Li, Li, Zhiyuan, Dongnan Liu +9 · 5 citations
    Computer Science · #Multimodal Machine Learning Applications
  26. Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent
    2022/07/08 by Zhiyuan Li, Tianhao Wang, Li, Zhiyuan +5 · 3 citations
    Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #FOS: Mathematics #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications #Optimization and Control (math.OC)
  27. Comparison of Polarized Radiative Transfer Codes Used by the EHT Collaboration
    2023/03/21 by Cora Prather, Ben Prather, Jason Dexter +294 · 4 citations
    Physics and Astronomy · #Astrophysical Phenomena and Observations #Astrophysics and Cosmic Phenomena #Pulsars and Gravitational Waves Research
  28. Structured Preconditioners in Adaptive Optimization: A Unified Analysis
    2025/03/13 by S. Xie, Xie, Shuo, Sashank J. Reddi +6 · 9 citations
    Computer Science · Decision Sciences · Mathematics · #Stochastic Gradient Optimization Techniques #Advanced Bandit Algorithms Research #Tensor decomposition and applications
  29. A Coefficient Makes SVRG Effective
    2023/11/09 by Yida Yin, Yin, Yida, Zhiqiu Xu +7 · 3 citations
    Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
  30. Thermal stress involved in TRPV2 promotes tumorigenesis through the pathways of HSP70/27 and PI3K/Akt/mTOR in esophageal squamous cell carcinoma
    2022/07/27 by Rongqi Huang, Shuai Li, Chao Tian +10 · 12 citations
    Neuroscience · Medicine · #Ion Channels and Receptors #Cardiovascular, Neuropeptides, and Oxidative Stress Research #Barrier Structure and Function Studies
  31. RDEIC: Accelerating Diffusion-Based Extreme Image Compression with Relay Residual Diffusion
    2024/10/03 by Zhiyuan Li, Yanhui Zhou, Li, Zhiyuan +7 · 4 citations
    Computer Science · #Advanced Data Compression Techniques #Image and Signal Denoising Methods #Medical Image Segmentation Techniques
  32. M31* and its circumnuclear environment
    2009/06/26 by Zhiyuan Li, Q. Daniel Wang, Bart P. Wakker · 1 citation
    Physics and Astronomy · #Galaxies: Formation, Evolution, Phenomena #Astrophysical Phenomena and Observations #Stellar, planetary, and galactic studies
  33. GWSpace: a multi-mission science data simulator for space-based gravitational wave detection
    2023/09/26 by En-Kun Li, Li, En-Kun, Han Wang +25 · 3 citations
    Earth and Planetary Sciences · Engineering · Physics and Astronomy · #Cosmology and Nongalactic Astrophysics (astro-ph.CO) #FOS: Physical sciences #GNSS positioning and interference #General Relativity and Quantum Cosmology (gr-qc) #Geophysics and Gravity Measurements #Instrumentation and Methods for Astrophysics (astro-ph.IM) #Pulsars and Gravitational Waves Research
  34. Why Are Convolutional Nets More Sample-Efficient than Fully-Connected Nets?
    2020/10/16 by Zhiyuan Li, Yi Zhang, Li, Zhiyuan +3 · 3 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms
  35. Octopus v4: Graph of language models
    2024/04/30 by Wei Chen, Chen, Wei, Zhiyuan Li +1 · 4 citations
    Environmental Science · #Species Distribution and Climate Change #cs.CL
  36. The Noether-Lefschetz conjecture and generalizations
    2014/12/11 by Nicolas Bergeron, Zhiyuan Li, Bergeron, Nicolas +4 · 1 citation
    Mathematics · #Advanced Algebra and Geometry #Algebraic Geometry (math.AG) #Algebraic Geometry and Number Theory #FOS: Mathematics #Geometry and complex manifolds #Number Theory (math.NT)
  37. External Large Foundation Model: How to Efficiently Serve Trillions of Parameters for Online Ads Recommendation
    2025/02/20 by Mingfu Liang, Liang, Mingfu, Xi Liu +195 · 5 citations
    Business, Management and Accounting · Computer Science · #Artificial Intelligence (cs.AI) #Consumer Market Behavior and Pricing #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Recommender Systems and Techniques
  38. Identity-Free Facial Expression Recognition using conditional Generative Adversarial Network
    2019/03/19 by Jie Cai, Zibo Meng, Cai, Jie +11 · 2 citations
    Computer Science · Psychology · #Computer Vision and Pattern Recognition (cs.CV) #Emotion and Mood Recognition #FOS: Computer and information sciences #Face and Expression Recognition #Face recognition and analysis
  39. Octo-planner: On-device Language Model for Planner-Action Agents
    2024/06/26 by Wei Chen, Chen, Wei, Zhiyuan Li +5 · 3 citations
    Computer Science · #Multi-Agent Systems and Negotiation #Semantic Web and Ontologies #AI-based Problem Solving and Planning
  40. Well-posedness for the backward problems in time for general time-fractional diffusion equation
    2020/01/26 by Giuseppe Floridia, Floridia, Giuseppe, Zhiyuan Li +3 · 1 citation
    Mathematics · #34A12 #35R11 #Analysis of PDEs (math.AP) #Differential Equations and Boundary Problems #Differential Equations and Numerical Methods #FOS: Mathematics #Fractional Differential Equations Solutions
  41. Octopus v3: Technical Report for On-device Sub-billion Multimodal AI Agent
    2024/04/17 by Wei Chen, Zhiyuan Li, Chen, Wei +1 · 4 citations
    Computer Science · #Multi-Agent Systems and Negotiation
  42. DeFRCN: Decoupled Faster R-CNN for Few-Shot Object Detection
    2021/08/20 by Limeng Qiao, Yuxuan Zhao, Qiao, Limeng +9 · 1 citation
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Adversarial Robustness in Machine Learning
  43. PENCIL: Long Thoughts with Short Memory
    2025/03/18 by Chenxiao Yang, Yang, Chenxiao, Nathan Srebro +5 · 1 voice · 3 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.CL #cs.LG
  44. OmniVLM: A Token-Compressed, Sub-Billion-Parameter Vision-Language Model for Efficient On-Device Inference
    2024/12/16 by Wei Chen, Chen, Wei, Zhiyuan Li +3 · 3 citations
    Computer Science · Neuroscience · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Brain Tumor Detection and Classification
  45. SSIVD-Net: A Novel Salient Super Image Classification & Detection Technique for Weaponized Violence
    2022/07/26 by Toluwani Aremu, Zhiyuan Li, Aremu, Toluwani +5 · 1 citation
    Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition
  46. A Theory of Learning with Autoregressive Chain of Thought
    2025/03/11 by Nirmit Joshi, Gal Vardi, Joshi, Nirmit +11 · 3 citations
    Psychology · Social Sciences · #Artificial Intelligence (cs.AI) #Computational Complexity (cs.CC) #Education and Critical Thinking Development #FOS: Computer and information sciences #Innovative Teaching and Learning Methods #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  47. PersonaLive! Expressive Portrait Image Animation for Live Streaming
    2025/12/12 by Zhiyuan Li, Li, Zhiyuan, Chi-Man Pun +7 · 1 voice
    Computer Science · Psychology · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face recognition and analysis #Generative Adversarial Networks and Image Synthesis #Social Robot Interaction and HRI #cs.CV
  48. Interaction of thymic stromal lymphopoietin, <scp>IL</scp>‐33, and their receptors in epithelial cells in eosinophilic chronic rhinosinusitis with nasal polyps
    2015/06/19 by B. Liao, Bo Liao, Peng Cao +26 · 1 citation
    Medicine · #Sinusitis and nasal conditions #Asthma and respiratory diseases #Allergic Rhinitis and Sensitization
  49. A multi-frequency study of sub-parsec jets with the Event Horizon Telescope
    2025/01/09 by Jan Röder, Maciek Wielgus, Andrei P. Lobanov +287 · 1 voice · 1 citation
    #astro-ph.HE #astro-ph.GA #astro-ph.IM
  50. Simplicity Bias via Global Convergence of Sharpness Minimization
    2024/10/21 by Khashayar Gatmiry, Zhiyuan Li, Gatmiry, Khashayar +5 · 1 citation
    Computer Science · Decision Sciences · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multi-Criteria Decision Making #Optimization and Variational Analysis #Risk and Portfolio Optimization #Statistics Theory (math.ST)
  51. Measurement of two-neutrino double electron capture half-life of 124Xe with PandaX-4T
    2024/11/21 by PandaX Collaboration, Zihao Bo, Bo, Zihao +197 · 1 citation
    Physics and Astronomy · #Neutrino Physics Research #Dark Matter and Cosmic Phenomena #Astrophysics and Cosmic Phenomena
  52. The Seeds of the FUTURE Sprout from History: Fuzzing for Unveiling Vulnerabilities in Prospective Deep-Learning Libraries
    2024/12/02 by Zhiyuan Li, Jingzheng Wu, Li, Zhiyuan +9 · 1 citation
    Computer Science · Social Sciences · #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Privacy-Preserving Technologies in Data #Software Engineering (cs.SE)
  53. AutoNeural: Co-Designing Vision-Language Models for NPU Inference
    2025/12/02 by Wei Chen, Liangmin Wu, Chen, Wei +24 · 2 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #cs.CL
  54. On Learning Verifiers and Implications to Chain-of-Thought Reasoning
    2025/05/28 by Maria-Florina Balcan, Avrim Blum, Balcan, Maria-Florina +5 · 2 citations
    Computer Science · #FOS: Computer and information sciences #Logic, Reasoning, and Knowledge #Logic, programming, and type systems #Machine Learning (cs.LG) #Machine Learning and Algorithms
  55. Weak-to-Strong Generalization Even in Random Feature Networks, Provably
    2025/03/04 by Kaifeng Lyu, Medvedev, Marko, Dingli Yu +8 · 1 citation
    Computer Science · #Face and Expression Recognition #Neural Networks and Applications #Anomaly Detection Techniques and Applications
  56. Kimi K3: Open Frontier Intelligence
    2026/07/27 by Kimi Team, Tongtong Bai, Yifan Bai +398 · 1 voice
    #cs.CL #cs.LG
  57. Hierarchical Domain Generalization
    2026/07/17 by Chenxiao Yang, Zhiyuan Li, Shai Ben-David +1
    #cs.LG
  58. Dynamics and geometry of the inner sub-parsec-scale jet in 3C 279 observed with the Event Horizon Telescope
    2026/07/17 by Hendrik Mueller, Sebastiano D. von Fellenberg, Ai-Ling Zeng +275
    #astro-ph.GA
  59. QuReC: All-in-One Image Restoration with Query-Specific Guidance and Local-Global Response Calibration
    2026/07/16 by Shen Zhou, Jinghui Zhang, Wenbo Huang +7
    #cs.CV
  60. Context-Adaptive Inference: A Unified Statistical and Foundation-Model View
    2026/07/25 by Yue Yao, Caleb N. Ellington, Jingyun Jia +9
    #stat.ML #cs.LG #stat.ME
  61. RoboHarness: Memory-Driven Orchestration of Heterogeneous Robot Policies for Long-Horizon Planning
    2026/07/20 by Jinbang Huang, Yuanzhao Hu, Zhiyuan Li +6
    #cs.RO
  62. Retrieval-Augmented Interpretable Learning: Towards Task-Specific Zero-Shot Models in Healthcare
    2026/07/20 by Sazan Mahbub, Caleb Ellington, Zhiyuan Li +4
    #cs.LG #cs.AI
  63. The transcription factor CtWRKY41 acts as a hub gene enhancing low-nitrogen tolerance in Coreopsis tinctoria Nutt․
    2026/07/27 by Shihao He, Yanan Wang, Tao Li +3
    Agricultural and Biological Sciences · Biochemistry, Genetics and Molecular Biology · #Plant Gene Expression Analysis #Plant Micronutrient Interactions and Effects #Plant nutrient uptake and metabolism