Zhen Qin
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Comanici, Gheorghe, Eric Bieber +6844 · 8 voices · 1393 citations
#cs.CL #cs.AI
- Transformer Memory as a Differentiable Search Index
2022/02/14 by Yi Tay, Tay, Yi, Vinh Q. Tran +24 · 1 voice · 48 citations
Computer Science · #Natural Language Processing Techniques #Text and Document Classification Technologies #Topic Modeling #cs.AI #cs.CL #cs.IR #cs.LG
- Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting
2023/06/30 by Zhen Qin, Qin, Zhen, Rolf Jagerman +21 · 1 voice · 62 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.IR #cs.LG
- Tensor Product Attention Is All You Need
2025/01/11 by Yifan Zhang, Yifeng Liu, Zhang, Yifan +11 · 10 voices · 6 citations
#cs.CL #cs.AI #cs.LG
- AlphaGo Moment for Model Architecture Discovery
2025/07/24 by Yixiu Liu, Yang Nan, Liu, Yixiu +14 · 12 voices · 7 citations
Computer Science · #Model-Driven Software Engineering Techniques #Software System Performance and Reliability #Advanced Software Engineering Methodologies
- MiniMax-01: Scaling Foundation Models with Lightning Attention
2025/01/14 by Ao Li, MiniMax, Aonian Li +191 · 3 voices · 46 citations
Computer Science · #Computation and Language (cs.CL) #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #cs.CL #cs.CV
- TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer
2023/07/27 by Zhen Qin, Dong Li, Li Dong +20 · 1 voice · 13 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling #cs.CL
- RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses
2022/10/12 by Honglei Zhuang, Zhuang, Honglei, Zhen Qin +15 · 26 citations
Computer Science · #Topic Modeling #Text and Document Classification Technologies #Sentiment Analysis and Opinion Mining
- The Devil in Linear Transformer
2022/10/19 by Zhen Qin, Qin, Zhen, Xiaodong Han +11 · 17 citations
Computer Science · #Topic Modeling #Text and Document Classification Technologies #Web Data Mining and Analysis
- Charformer: Fast Character Transformers via Gradient-based Subword Tokenization
2021/06/23 by Yi Tay, Vinh Q. Tran, Tay, Yi +17 · 14 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
- HGRN2: Gated Linear RNNs with State Expansion
2024/04/11 by Zhen Qin, Songlin Yang, Qin, Zhen +11 · 24 citations
Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Speech Recognition and Synthesis #Topic Modeling
- Hierarchically Gated Recurrent Neural Network for Sequence Modeling
2023/11/08 by Zhen Qin, Qin, Zhen, Songlin Yang +3 · 18 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Bioinformatics #Natural Language Processing Techniques #Topic Modeling
- Beyond Yes and No: Improving Zero-Shot LLM Rankers via Scoring Fine-Grained Relevance Labels
2023/10/21 by Honglei Zhuang, Zhuang, Honglei, Zhen Qin +10 · 17 citations
Computer Science · #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Information Retrieval (cs.IR) #Machine Learning and Data Classification #Text and Document Classification Technologies
- RRM: Robust Reward Model Training Mitigates Reward Hacking
2024/09/20 by Tianqi Liu, Liu, Tianqi, Wei Xiong +33 · 20 citations
Psychology · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Human-Automation Interaction and Safety
- Query Expansion by Prompting Large Language Models
2023/05/05 by Rolf Jagerman, Jagerman, Rolf, Honglei Zhuang +7 · 10 citations
Computer Science · #FOS: Computer and information sciences #H.3.3 #Information Retrieval (cs.IR) #Natural Language Processing Techniques #Topic Modeling #Web Data Mining and Analysis
- Inference Scaling for Long-Context Retrieval Augmented Generation
2024/10/06 by Zhenrui Yue, Honglei Zhuang, Yue, Zhenrui +17 · 19 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Image Retrieval and Classification Techniques
- Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models
2024/01/09 by Zhen Qin, Weigao Sun, Qin, Zhen +9 · 10 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Topic Modeling
- Are Pre-trained Convolutions Better than Pre-trained Transformers?
2021/05/07 by Yi Tay, Mostafa Dehghani, Tay, Yi +12 · 1 voice · 3 citations
Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Towards Disentangling Relevance and Bias in Unbiased Learning to Rank
2022/12/28 by Yunan Zhang, Zhang, Yunan, Le Yan +13 · 6 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Face and Expression Recognition #Industrial Vision Systems and Defect Detection #Information Retrieval (cs.IR)
- Building Math Agents with Multi-Turn Iterative Preference Learning
2024/09/04 by Wei Xiong, Xiong, Wei, Chengshuai Shi +23 · 11 citations
Computer Science · #Educational Technology and Assessment #FOS: Computer and information sciences #Fuzzy Logic and Control Systems #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Rough Sets and Fuzzy Logic
- English Learners’ Use of Segmental and Suprasegmental Cues to Stress in Lexical Access: An Eye‐Tracking Study
2018/03/30 by Katrina Connell, Simone Hüls, Maria Teresa Martínez‐García +5 · 4 citations
Neuroscience · Psychology · #Neurobiology of Language and Bilingualism #Phonetics and Phonology Research #Reading and Literacy Development
- Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes
2023/12/11 by Zhen Qin, Daoyuan Chen, Qin, Zhen +9 · 6 citations
Biochemistry, Genetics and Molecular Biology · #DNA and Biological Computing #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Scaling Laws for Linear Complexity Language Models
2024/06/24 by Xuyang Shen, Dong Li, Shen, Xuyang +9 · 7 citations
Computer Science · #Natural Language Processing Techniques
- TAVGBench: Benchmarking Text to Audible-Video Generation
2024/04/22 by Yuxin Mao, Xuyang Shen, Mao, Yuxin +13 · 8 citations
Computer Science · Engineering · Social Sciences · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Multimedia (cs.MM) #Multimedia Communication and Technology #Video Analysis and Summarization
- Hybrid Latent Reasoning via Reinforcement Learning
2025/05/24 by Zhenrui Yue, Yue, Zhenrui, Bowen Jin +15 · 6 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Reinforcement Learning in Robotics
- RD-Suite: A Benchmark for Ranking Distillation
2023/06/07 by Zhen Qin, Qin, Zhen, Rolf Jagerman +15 · 3 citations
Computer Science · #Machine Learning and Data Classification #Imbalanced Data Classification Techniques #Machine Learning and Algorithms
- PaRaDe: Passage Ranking using Demonstrations with Large Language Models
2023/10/22 by Andrew Drozdov, Honglei Zhuang, Drozdov, Andrew +19 · 1 voice · 2 citations
#cs.IR
- CO2: Efficient Distributed Training with Full Communication-Computation Overlap
2024/01/29 by Weigao Sun, Zhen Qin, Sun, Weigao +13 · 3 citations
Medicine · Computer Science · #Medical Imaging Techniques and Applications #IoT and Edge/Fog Computing #Energy Efficient Wireless Sensor Networks
- PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs
2024/06/05 by Rongzhi Zhang, Jiaming Shen, Zhang, Rongzhi +17 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- All-pairs Consistency Learning for Weakly Supervised Semantic Segmentation
2023/08/08 by Weixuan Sun, Sun, Weixuan, Yanhao Zhang +13 · 2 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Nasal Respiration is Necessary for the Generation of γ Oscillation in the Olfactory Bulb
2018/12/13 by Liujing Zhuang, Bin Zhang, Zhen Qin +1 · 1 citation
Neuroscience · Nursing · #Biochemical Analysis and Sensing Techniques #Neural dynamics and brain function #Olfactory and Sensory Function Studies
- Predicting Text Preference Via Structured Comparative Reasoning
2023/11/14 by Jing Nathan Yan, Tianqi Liu, Yan, Jing Nathan +21 · 2 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Advanced Text Analysis Techniques
- Consolidating Ranking and Relevance Predictions of Large Language Models through Post-Processing
2024/04/17 by Le Yan, Zhen Qin, Yan, Le +11 · 2 citations
Computer Science · #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Natural Language Processing Techniques #Topic Modeling
- Toeplitz Neural Network for Sequence Modeling
2023/05/08 by Zhen Qin, Qin, Zhen, Xiaodong Han +15 · 2 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Guaranteed Nonconvex Factorization Approach for Tensor Train Recovery
2024/01/05 by Zhen Qin, Qin, Zhen, Michael B. Wakin +3 · 4 citations
Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Microwave Imaging and Scattering Analysis #Optimization and Control (math.OC) #Signal Processing (eess.SP) #Sparse and Compressive Sensing Techniques #Tensor decomposition and applications #electronic engineering #information engineering
- Error Analysis of Tensor-Train Cross Approximation
2022/07/09 by Zhen Qin, Alexander Lidiak, Qin, Zhen +9 · 1 citation
Mathematics · Physics and Astronomy · #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Solar and Space Plasma Dynamics #Tensor decomposition and applications
- Learning List-Level Domain-Invariant Representations for Ranking
2022/12/21 by Ruicheng Xian, Honglei Zhuang, Xian, Ruicheng +17 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG)
- You Only Scan Once: Efficient Multi-dimension Sequential Modeling with LightNet
2024/05/31 by Zhen Qin, Yuxin Mao, Qin, Zhen +11 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Neural Networks and Applications
- Exploring Transformer Extrapolation
2023/07/19 by Zhen Qin, Qin, Zhen, Yiran Zhong +3 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Convergence of Sign-based Random Reshuffling Algorithms for Nonconvex Optimization
2023/10/24 by Zhen Qin, Qin, Zhen, Zhishuai Liu +3 · 1 citation
Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Optimization and Control (math.OC) #Parallel #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Learning Multi-Pattern Normalities in the Frequency Domain for Efficient Time Series Anomaly Detection
2023/11/26 by Feiyi Chen, Chen, Feiyi, Y. Zhang +13 · 1 citation
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Security and Intrusion Detection #Time Series Analysis and Forecasting
- LLM Alignment as Retriever Optimization: An Information Retrieval Perspective
2025/02/06 by Bowen Jin, Jin, Bowen, Jinsung Yoon +13 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Library Science and Information Systems
- TaIRE1‐mediated unconventional splicing of the TabZIP60 mRNA and the miR172 precursor regulates heat stress tolerance in wheat
2025/07/03 by Haoran Li, Zhen Qin, Xiaoli Geng +13 · 1 voice · 1 citation
Agricultural and Biological Sciences · Biochemistry, Genetics and Molecular Biology · #Heat shock proteins research #Plant Stress Responses and Tolerance #RNA Research and Splicing
- Linear Attention Sequence Parallelism
2024/04/03 by Weigao Sun, Zhen Qin, Sun, Weigao +9 · 1 citation
Computer Science · #Computability, Logic, AI Algorithms #Neural Networks and Applications
- Enhancing Quantum State Reconstruction with Structured Classical Shadows
2025/01/06 by Zhen Qin, Qin, Zhen, Joseph M. Lukens +4 · 2 citations
Computer Science · Physics and Astronomy · #FOS: Mathematics #FOS: Physical sciences #Laser-Matter Interactions and Applications #Optimization and Control (math.OC) #Quantum Information and Cryptography #Quantum Mechanics and Applications #Quantum Physics (quant-ph)
- Optimal quantum state tomography with local informationally complete measurements
2024/08/13 by Casey Jameson, Jameson, Casey, Zhen Qin +9 · 2 citations
Computer Science · Physics and Astronomy · #FOS: Physical sciences #Quantum Computing Algorithms and Architecture #Quantum Information and Cryptography #Quantum Mechanics and Applications #Quantum Physics (quant-ph)
- Unlocking the Secrets of Linear Complexity Sequence Model from A Unified Perspective
2024/05/27 by Zhen Qin, Xuyang Shen, Qin, Zhen +11 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Data Mining and Machine Learning Applications #FOS: Computer and information sciences
- Federated Data-Efficient Instruction Tuning for Large Language Models
2024/10/14 by Zhen Qin, Qin, Zhen, Zhaohui Wu +5 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- Can Pre-training Indicators Reliably Predict Fine-tuning Outcomes of LLMs?
2025/04/16 by Hansi Zeng, Kai Hui, Zeng, Hansi +11 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Imbalanced Data Classification Techniques
- Exposure-Based Reinforcement Learning to Rank
2026/07/14 by Harrie Oosterhuis, Rolf Jagerman, Zhen Qin +1
#cs.LG #cs.IR