Daniel Bershatsky
- LoTR: Low Tensor Rank Weight Adaptation
2024/02/02 by Daniel Bershatsky, Bershatsky, Daniel, Daria Cherniuk +7 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques
- Survey on Large Scale Neural Network Training
2022/02/21 by Julia Gusak, Gusak, Julia, Daria Cherniuk +19 · 1 citation
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
- Few-Bit Backward: Quantized Gradients of Activation Functions for Memory Footprint Reduction
2022/02/01 by Georgii Novikov, Novikov, Georgii, Daniel Bershatsky +9 · 1 citation
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications
- NAG-GS: Semi-Implicit, Accelerated and Robust Stochastic Optimizer
2022/09/29 by Valentin Leplat, Daniil Merkulov, Leplat, Valentin +7 · 1 citation
Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and ELM #Numerical Analysis (math.NA) #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques