Kobyzev, Ivan
- DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation
2022/10/14 by Mojtaba Valipour, Valipour, Mojtaba, Mehdi Rezagholizadeh +5 · 1 voice · 26 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Topic Modeling #Multimodal Machine Learning Applications
- KronA: Parameter Efficient Tuning with Kronecker Adapter
2022/12/20 by Edalati, Ali, Tahaei, Marzieh, Kobyzev, Ivan +3 · 11 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Hyperparameter Optimization for Large Language Model Instruction-Tuning
2023/12/01 by Tribes, Christophe, Benarroch-Lelong, Sacha, Lu, Peng +1 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Optimization and Control (math.OC)
- A Short Study on Compressing Decoder-Based Language Models
2021/10/16 by Li, Tianda, Mesbahi, Yassir El, Kobyzev, Ivan +6 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Learning Functions on Multiple Sets using Multi-Set Transformers
2022/06/30 by Kira Selby, Ahmad Rashid, Selby, Kira +7 · 1 citation
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms
- Do we need Label Regularization to Fine-tune Pre-trained Language Models?
2022/05/25 by Kobyzev, Ivan, Jafari, Aref, Rezagholizadeh, Mehdi +5 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity
2024/10/01 by Metel, Michael R., Lu, Peng, Chen, Boxing +2 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Equivariant Finite Normalizing Flows
2021/10/16 by Bose, Avishek Joey, Brubaker, Marcus, Kobyzev, Ivan · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- ReGLA: Refining Gated Linear Attention
2025/02/03 by Lu, Peng, Kobyzev, Ivan, Rezagholizadeh, Mehdi +2 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences