Wang, Hongyi
- BPF for storage: an exokernel-inspired approach
2021/02/25 by Yu Jian Wu, Wu, Yu Jian, Hongyi Wang +12 · 2 voices
Computer Science · #Advanced Data Storage Technologies #Parallel Computing and Optimization Techniques #Distributed systems and fault tolerance
- Federated Learning with Matched Averaging
2020/02/15 by Wang, Hongyi, Yurochkin, Mikhail, Sun, Yuekai +2 · 22 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Attack of the Tails: Yes, You Really Can Backdoor Federated Learning
2020/07/09 by Hongyi Wang, Kartik K. Sreenivasan, Wang, Hongyi +13 · 22 citations
Computer Science · #Adversarial Robustness in Machine Learning #Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Parallel #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
- FedML: A Research Library and Benchmark for Federated Machine Learning
2020/07/27 by Chaoyang He, Songze Li, He, Chaoyang +34 · 29 citations
Computer Science · #Privacy-Preserving Technologies in Data #Cryptography and Data Security #Blockchain Technology Applications and Security
- TrustLLM: Trustworthiness in Large Language Models
2024/01/01 by Yue Huang, Huang, Yue, Lichao Sun +136 · 30 citations
Medicine · Computer Science · #Artificial Intelligence in Healthcare and Education #Privacy-Preserving Technologies in Data #Explainable Artificial Intelligence (XAI)
- FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations
2024/09/09 by Ziyao Wang, Wang, Ziyao, Shen, Zheyu +9 · 33 citations
Computer Science · #Topic Modeling #Speech Recognition and Synthesis
- A Field Guide to Federated Optimization
2021/07/14 by Jianyu Wang, Wang, Jianyu, Zachary Charles +103 · 15 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
- Mixed Transformer U-Net For Medical Image Segmentation
2021/11/08 by Hongyi Wang, Wang, Hongyi, Shiao Xie +11 · 12 citations
Computer Science · Neuroscience · #AI in cancer detection #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Brain Tumor Detection and Classification #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #electronic engineering #information engineering
- FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAs
2024/01/08 by Shulin Zeng, Jun Liu, Zeng, Shulin +31 · 12 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Mixture of Attention Spans: Optimizing LLM Inference Efficiency with Heterogeneous Sliding-Window Lengths
2024/06/21 by Tianyu Fu, Fu, Tianyu, Haofeng Huang +23 · 14 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- LLM360: Towards Fully Transparent Open-Source LLMs
2023/12/11 by Zhengzhong Liu, Aurick Qiao, Liu, Zhengzhong +53 · 11 citations
Computer Science · Materials Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Natural Language Processing Techniques #Topic Modeling
- SlimPajama-DC: Understanding Data Combinations for LLM Training
2023/09/19 by Zhiqiang Shen, Shen, Zhiqiang, Tianhua Tao +16 · 9 citations
Computer Science · Decision Sciences · #Natural Language Processing Techniques #Topic Modeling #Data Quality and Management
- MPCFormer: fast, performant and private Transformer inference with MPC
2022/11/02 by Dacheng Li, Rulin Shao, Li, Dacheng +9 · 7 citations
Computer Science · Engineering · #Cryptography and Data Security #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Stochastic Gradient Optimization Techniques
- DRACO: Byzantine-resilient Distributed Training via Redundant Gradients
2018/03/27 by Lingjiao Chen, Chen, Lingjiao, Hongyi Wang +5 · 5 citations
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Distributed #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE) #Parallel #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
- ATOMO: Communication-efficient Learning via Atomic Sparsification
2018/06/11 by Wang, Hongyi, Sievert, Scott, Charles, Zachary +3 · 3 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #and Cluster Computing (cs.DC)
- Fusing Models with Complementary Expertise
2023/10/02 by Hongyi Wang, Wang, Hongyi, Felipe Maia Polo +9 · 5 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Multimodal Machine Learning Applications #Topic Modeling
- A predictive machine learning force field framework for liquid electrolyte development
2024/04/10 by Gong, Sheng, Zhang, Yumin, Mu, Zhenliang +13 · 7 citations
#Computational Physics (physics.comp-ph) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Materials Science (cond-mat.mtrl-sci)
- CITER: Collaborative Inference for Efficient Large Language Model Decoding with Token-Level Routing
2025/02/04 by Wenhao Zheng, Zheng, Wenhao, Yixiao Chen +15 · 8 citations
Computer Science · #Advanced Graph Neural Networks #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Performance (cs.PF) #Topic Modeling
- LLM360 K2: Building a 65B 360-Open-Source Large Language Model from Scratch
2025/01/13 by Zhengzhong Liu, Bowen Tan, Liu, Zhengzhong +47 · 7 citations
Computer Science · #Natural Language Processing Techniques
- M2OST: Many-to-one Regression for Predicting Spatial Transcriptomics from Digital Pathology Images
2024/09/23 by Hongyi Wang, Wang, Hongyi, Xiuju Du +9 · 5 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #AI in cancer detection #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Gene expression and cancer classification #Single-cell and spatial transcriptomics
- Evaluating Large Language Models with Psychometrics
2024/06/25 by Li, Yuan, Huang, Yue, Wang, Hongyi +4 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Rethinking Multiple Instance Learning for Whole Slide Image Classification: A Bag-Level Classifier is a Good Instance-Level Teacher
2023/12/02 by Wang, Hongyi, Luo, Luyang, Wang, Fang +5 · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- AMP: Automatically Finding Model Parallel Strategies with Heterogeneity Awareness
2022/10/13 by Dacheng Li, Hongyi Wang, Li, Dacheng +5 · 2 citations
Computer Science · #Cloud Computing and Resource Management #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Software System Performance and Reliability
- SHED: Shapley-Based Automated Dataset Refinement for Instruction Fine-Tuning
2024/04/23 by Yexiao He, He, Yexiao, Ziyao Wang +13 · 3 citations
Computer Science · #Computation and Language (cs.CL) #Educational Technology and Assessment #FOS: Computer and information sciences #Machine Learning (cs.LG)
- ErasureHead: Distributed Gradient Descent without Delays Using Approximate Gradient Coding
2019/01/28 by Hongyi Wang, Wang, Hongyi, Zachary Charles +3 · 2 citations
Engineering · Computer Science · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data
- On the Utility of Gradient Compression in Distributed Training Systems
2021/02/28 by Saurabh Agarwal, Agarwal, Saurabh, Hongyi Wang +5 · 2 citations
Computer Science · Medicine · #Stochastic Gradient Optimization Techniques #Advanced MRI Techniques and Applications #Medical Imaging Techniques and Applications
- DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation
2019/07/29 by Shashank Rajput, Hongyi Wang, Rajput, Shashank +5 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Accordion: Adaptive Gradient Communication via Critical Learning Regime Identification
2020/10/29 by Agarwal, Saurabh, Wang, Hongyi, Lee, Kangwook +2 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- ViT-1.58b: Mobile Vision Transformers in the 1-bit Era
2024/06/26 by Yuan, Zhengqing, Zhou, Rong, Wang, Hongyi +3 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Rare Gems: Finding Lottery Tickets at Initialization
2022/02/24 by Kartik K. Sreenivasan, Sreenivasan, Kartik, Jy-yong Sohn +14 · 1 citation
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Stochastic Gradient Optimization Techniques
- Why Representation Engineering Works: A Theoretical and Empirical Study in Vision-Language Models
2025/03/25 by Bowei Tian, Tian, Bowei, Meng Liu +6 · 3 citations
Computer Science · Neuroscience · #Artificial Intelligence (cs.AI) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Neurobiology of Language and Bilingualism
- Does compressing activations help model parallel training?
2023/01/06 by Song Bian, Bian, Song, Dacheng Li +7 · 1 citation
Computer Science · #Algorithms and Data Compression #Machine Learning and Data Classification #Generative Adversarial Networks and Image Synthesis
- Federated Learning as Variational Inference: A Scalable Expectation Propagation Approach
2023/02/08 by Guo, Han, Greengard, Philip, Wang, Hongyi +3 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Cuttlefish: Low-Rank Model Training without All the Tuning
2023/05/04 by Wang, Hongyi, Agarwal, Saurabh, U-chupala, Pongsakorn +3 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Memory-adaptive Depth-wise Heterogeneous Federated Learning
2023/03/08 by Kai Zhang, Yutong Dai, Zhang, Kai +9 · 1 citation
Computer Science · Social Sciences · #FOS: Computer and information sciences #Internet Traffic Analysis and Secure E-voting #Machine Learning (cs.LG) #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data
- Crystal: Illuminating LLM Abilities on Language and Code
2024/11/06 by Tao, Tianhua, Li, Junbo, Tan, Bowen +8 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Software Engineering (cs.SE)
- Maestro: Uncovering Low-Rank Structures via Trainable Decomposition
2023/08/28 by Samuel Horváth, Stefanos Laskaridis, Horvath, Samuel +5 · 1 citation
Engineering · Computer Science · #Sparse and Compressive Sensing Techniques #Advanced Neural Network Applications #Medical Image Segmentation Techniques
- GridFormer: Towards Accurate Table Structure Recognition via Grid Prediction
2023/09/26 by Lyu, Pengyuan, Ma, Weihong, Wang, Hongyi +5 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- M2ORT: Many-To-One Regression Transformer for Spatial Transcriptomics Prediction from Histopathology Images
2024/01/19 by Wang, Hongyi, Du, Xiuju, Liu, Jing +3 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimedia (cs.MM)
- Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wild
2024/10/07 by Zhao, Xinyu, Sun, Guoheng, Cai, Ruisi +13 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- From EduVisBench to EduVisAgent: A Benchmark and Multi-Agent Framework for Reasoning-Driven Pedagogical Visualization
2025/05/22 by Haiying Ji, Ji, Haonian, Shi Qiu +12 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Model-Driven Software Engineering Techniques #Semantic Web and Ontologies