Yu, Dianhai
- PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR System
2022/06/07 by Chenxia Li, Li, Chenxia, Weiwei Liu +21 · 22 citations
Computer Science · #Handwritten Text Recognition Techniques #Image Retrieval and Classification Techniques #Advanced Image and Video Retrieval Techniques
- ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
2021/07/05 by Sun, Yu, Wang, Shuohuan, Feng, Shikun +19 · 11 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- MoESys: A Distributed and Efficient Mixture-of-Experts Training and Inference System for Internet Services
2022/05/20 by Dianhai Yu, Yu, Dianhai, Liang Shen +11 · 8 citations
Computer Science · #Advanced Neural Network Applications #Recommender Systems and Techniques #Stochastic Gradient Optimization Techniques
- PaddleOCR 3.0 Technical Report
2025/07/08 by Cheng Cui, Ting Sun, Cui, Cheng +33 · 33 citations
Computer Science · #Handwritten Text Recognition Techniques #Natural Language Processing Techniques #Topic Modeling
- NACL: A General and Effective KV Cache Eviction Framework for LLMs at Inference Time
2024/08/07 by Yilong Chen, Chen, Yilong, Guoxia Wang +17 · 12 citations
Computer Science · Social Sciences · Business, Management and Accounting · #Digital Rights Management and Security #Artificial Intelligence in Law #Financial Distress and Bankruptcy Prediction
- PP-OCRv2: Bag of Tricks for Ultra Lightweight OCR System
2021/09/07 by Du, Yuning, Li, Chenxia, Guo, Ruoyu +9 · 5 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- PP-Matting: High-Accuracy Natural Image Matting
2022/04/20 by Guowei Chen, Yi Liu, Chen, Guowei +25 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Enhancement Techniques #Image and Signal Denoising Methods #Visual Attention and Saliency Detection
- PP-PicoDet: A Better Real-Time Object Detector on Mobile Devices
2021/11/01 by Guanghua Yu, Yu, Guanghua, Qinyao Chang +27 · 4 citations
Computer Science · Neuroscience · #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques #Brain Tumor Detection and Classification
- PP-StructureV2: A Stronger Document Analysis System
2022/10/11 by Chenxia Li, Ruoyu Guo, Li, Chenxia +15 · 4 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Image Processing and 3D Reconstruction #Image Retrieval and Classification Techniques
- TA-MoE: Topology-Aware Large Scale Mixture-of-Expert Training
2023/02/20 by Chen, Chang, Li, Min, Wu, Zhihua +2 · 4 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- FlashMask: Efficient and Rich Mask Extension of FlashAttention
2024/10/02 by Wang, Guoxia, Zeng, Jinle, Xiao, Xiyuan +7 · 6 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- PP-LiteSeg: A Superior Real-Time Semantic Segmentation Model
2022/04/06 by Juncai Peng, Peng, Juncai, Yi Liu +29 · 2 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- HeterPS: Distributed Deep Learning With Reinforcement Learning Based Scheduling in Heterogeneous Environments
2021/11/20 by Liu, Ji, Wu, Zhihua, Yu, Dianhai +6 · 2 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Parallel #Systems and Control (eess.SY) #and Cluster Computing (cs.DC) #electronic engineering #information engineering
- Low-Precision Training of Large Language Models: Methods, Challenges, and Opportunities
2025/05/02 by Zhiwei Hao, Hao, Zhiwei, Jianyuan Guo +15 · 5 citations
Computer Science · #cs.AI #cs.LG
- Beyond Self-Supervision: A Simple Yet Effective Network Distillation Alternative to Improve Backbones
2021/03/10 by Cheng Cui, Cui, Cheng, Ruoyu Guo +23 · 1 citation
Computer Science · Medicine · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #COVID-19 diagnosis using AI
- End-to-end Adaptive Distributed Training on PaddlePaddle
2021/12/06 by Ao, Yulong, Wu, Zhihua, Yu, Dianhai +10 · 1 citation
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
2021/12/23 by Wang, Shuohuan, Sun, Yu, Xiang, Yang +26 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Large-scale Knowledge Distillation with Elastic Heterogeneous Computing Resources
2022/07/14 by Liu, Ji, Dong, Daxiang, Wang, Xi +5 · 1 citation
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Boosting Distributed Training Performance of the Unpadded BERT Model
2022/08/17 by Zeng, Jinle, Li, Min, Wu, Zhihua +4 · 1 citation
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- ERNIE-mmLayout: Multi-grained MultiModal Transformer for Document Understanding
2022/09/18 by Wenjin Wang, Wang, Wenjin, Zhengjie Huang +19 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Model
2025/10/16 by Cheng Cui, Ting Sun, Cui, Cheng +31 · 9 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- Distilling Knowledge from Pre-trained Language Models via Text Smoothing
2020/05/08 by Xing Wu, Wu, Xing, Yibing Liu +5 · 1 citation
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Sound (cs.SD) #Topic Modeling #electronic engineering #information engineering
- SeWA: Selective Weight Average via Probabilistic Masking
2025/02/14 by Wang, Peng, Hu, Shengchao, Tao, Zerui +5 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)