Borzunov, Alexander
- SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression
2023/06/05 by Tim Dettmers, Ruslan Svirschevski, Dettmers, Tim +15 · 1 voice · 35 citations
Computer Science · Engineering · #Ferroelectric and Negative Capacitance Devices #Speech Recognition and Synthesis #Topic Modeling #cs.CL #cs.LG
- Petals: Collaborative Inference and Fine-tuning of Large Models
2022/09/02 by Alexander Borzunov, Dmitry Baranchuk, Borzunov, Alexander +13 · 2 voices · 7 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC) #cs.DC #cs.LG
- Distributed Deep Learning in Open Collaborations
2021/06/18 by Michael Diskin, Alexey Bukhtiyarov, Diskin, Michael +29 · 1 voice · 4 citations
#cs.LG #cs.DC
- Distributed Inference and Fine-tuning of Large Language Models Over The Internet
2023/12/13 by Alexander Borzunov, Max Ryabinin, Borzunov, Alexander +13 · 11 citations
Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #Topic Modeling #and Cluster Computing (cs.DC)
- SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient
2023/01/27 by Max Ryabinin, Ryabinin, Max, Tim Dettmers +5 · 6 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- Secure Distributed Training at Scale
2021/06/21 by Eduard Gorbunov, Gorbunov, Eduard, Alexander Borzunov +5 · 1 citation
Computer Science · #Cryptography and Data Security #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)