Irina Rish
- Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interference
2018/10/28 by Matthew Riemer, Riemer, Matthew, Ignacio Cases +11 · 78 citations
Computer Science · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications
- Simple and Scalable Strategies to Continually Pre-train Large Language Models
2024/03/13 by Adam Ibrahim, Ibrahim, Adam, Benjamin Therien +14 · 3 voices · 27 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- Towards Continual Reinforcement Learning: A Review and Perspectives
2020/12/25 by Khimya Khetarpal, Matthew Riemer, Khetarpal, Khimya +5 · 34 citations
Biochemistry, Genetics and Molecular Biology · #Viral Infectious Diseases and Gene Expression in Insects
- Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting
2023/10/12 by Kashif Rasul, Rasul, Kashif, Arjun Ashok +30 · 49 citations
Decision Sciences · Computer Science · #Stock Market Forecasting Methods #Time Series Analysis and Forecasting #Forecasting Techniques and Applications
- RedPajama: an Open Dataset for Training Large Language Models
2024/11/19 by Maurice Weber, Daniel Fu, Weber, Maurice +34 · 84 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalization
2021/06/11 by Kartik Ahuja, Ahuja, Kartik, Ethan Caballero +11 · 21 citations
Computer Science · #Adversarial Robustness in Machine Learning #Bayesian Modeling and Causal Inference #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms
- Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks
2015/11/19 by Pouya Bashivan, Bashivan, Pouya, Irina Rish +5 · 19 citations
Neuroscience · #EEG and Brain-Computer Interfaces #Neural dynamics and brain function #Neural and Behavioral Psychology Studies
- Context is Key: A Benchmark for Forecasting with Essential Textual Information
2024/10/24 by Andrew Williams, Williams, Andrew Robert, Arjun Ashok +19 · 27 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Semantic Web and Ontologies
- Continual Learning with Foundation Models: An Empirical Study of Latent Replay
2022/04/30 by Оleksiy Ostapenko, Ostapenko, Oleksiy, Timothée Lesort +11 · 8 citations
Computer Science · #Domain Adaptation and Few-Shot Learning
- MuLoCo: Muon is a practical inner optimizer for DiLoCo
2025/05/29 by Benjamin Thérien, Benjamin Therien, Xiaolong Huang +8 · 1 voice · 9 citations
Computer Science · Materials Science · #Big Data and Digital Economy #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Topic Modeling #cs.LG
- Towards Scaling Difference Target Propagation by Learning Backprop Targets
2022/01/31 by Maxence Ernoult, Ernoult, Maxence, Fabrice Normandin +13 · 6 citations
Computer Science · Engineering · Neuroscience · #Advanced Memory and Neural Computing #FOS: Computer and information sciences #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE) #Neural dynamics and brain function
- Spectra: Surprising Effectiveness of Pretraining Ternary Language Models at Scale
2024/07/17 by Ayush Kaushal, Kaushal, Ayush, Tejas Vaidhya +9 · 1 voice · 4 citations
Computer Science · #68T30 #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.6 #I.2.7 #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot Compression
2023/09/25 by Ayush Kaushal, Tejas Vaidhya, Kaushal, Ayush +3 · 8 citations
Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computational Physics and Python Applications #FOS: Computer and information sciences #Parallel Computing and Optimization Techniques #Tensor decomposition and applications
- A Survey on Practical Applications of Multi-Armed and Contextual Bandits
2019/04/02 by Djallel Bouneffouf, Irina Rish, Bouneffouf, Djallel +1 · 4 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Search Problems #Reinforcement Learning in Robotics
- Continual Learning with Self-Organizing Maps
2019/04/19 by Pouya Bashivan, Bashivan, Pouya, Martin Schrimpf +9 · 4 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning and ELM #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE)
- Maximum State Entropy Exploration using Predecessor and Successor Representations
2023/06/26 by Arnav Jain, Jain, Arnav Kumar, Lucas Lehnert +5 · 5 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification #Reinforcement Learning in Robotics
- Beyond Backprop: Online Alternating Minimization with Auxiliary Variables
2018/06/24 by Anna Choromanska, Choromanska, Anna, Benjamin Cowen +19 · 6 citations
Computer Science · #Stochastic Gradient Optimization Techniques #Machine Learning and ELM #Domain Adaptation and Few-Shot Learning
- SAND-mask: An Enhanced Gradient Masking Strategy for the Discovery of Invariances in Domain Generalization
2021/06/04 by Soroosh Shahtalebi, Jean-Christophe Gagnon-Audet, Shahtalebi, Soroosh +9 · 4 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Understanding Continual Learning Settings with Data Distribution Drift Analysis
2021/04/04 by Timothée Lesort, Lesort, Timothée, M. Caccia +3 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Data Stream Mining Techniques #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Machine Learning and ELM
- Parametric Scattering Networks
2021/07/20 by Shanel Gauthier, Benjamin Therien, Gauthier, Shanel +13 · 3 citations
Computer Science · #F.2.2 #FOS: Computer and information sciences #FOS: Electrical engineering #Face and Expression Recognition #I.2.7 #Image and Signal Denoising Methods #Machine Learning (cs.LG) #Optical measurement and interference techniques #Signal Processing (eess.SP) #electronic engineering #information engineering
- Non-Adversarial Inverse Reinforcement Learning via Successor Feature Matching
2024/11/11 by Arnav Kumar Jain, Harley Wiltzer, Jain, Arnav Kumar +9 · 1 voice · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.LG
- Scaling Laws for the Few-Shot Adaptation of Pre-trained Image Classifiers
2021/10/13 by Gabriele Prato, Simon Guiroy, Prato, Gabriele +7 · 2 citations
Computer Science · Medicine · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Challenging Common Assumptions about Catastrophic Forgetting
2022/07/10 by Timothée Lesort, Оleksiy Ostapenko, Lesort, Timothée +11 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Gradient Masked Averaging for Federated Learning
2022/01/28 by Irene Tenison, Sai Aravind Sreeramadas, Tenison, Irene +9 · 2 citations
Computer Science · Mathematics · #Advanced Graph Neural Networks #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data #Statistical Methods and Inference
- A Survey on Compositional Generalization in Applications
2023/02/02 by Baihan Lin, Lin, Baihan, Djallel Bouneffouf +3 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Geochemistry and Geologic Mapping #Machine Learning (cs.LG) #Rough Sets and Fuzzy Logic #Symbolic Computation (cs.SC)
- Enabling Realtime Reinforcement Learning at Scale with Staggered Asynchronous Inference
2024/12/18 by Matthew Riemer, Riemer, Matthew, Gopeshh Subbaraj +5 · 4 citations
Computer Science · Engineering · #Neural Networks and Applications #Reinforcement Learning in Robotics #Analog and Mixed-Signal Circuit Design
- Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training
2025/03/04 by Vaibhav Singh, Singh, Vaibhav, Paul Janson +11 · 3 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms
- Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoning
2024/11/04 by Md Rifat Arefin, Arefin, Md Rifat, Gopeshh Subbaraj +11 · 2 citations
Computer Science · #AI-based Problem Solving and Planning #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Handling Delay in Real-Time Reinforcement Learning
2025/03/30 by Ivan Anokhin, Anokhin, Ivan, Rishav Rishav +9 · 3 citations
Computer Science · #Reinforcement Learning in Robotics #Advanced Neural Network Applications #Explainable Artificial Intelligence (XAI)
- GitChameleon: Unmasking the Version-Switching Capabilities of Code Generation Models
2024/11/05 by Nizar Islah, Justine Gehring, Islah, Nizar +11 · 2 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model-Driven Software Engineering Techniques #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability
- Bandit Models of Human Behavior: Reward Processing in Mental Disorders
2017/06/07 by Djallel Bouneffouf, Irina Rish, Bouneffouf, Djallel +3 · 2 citations
Biochemistry, Genetics and Molecular Biology · Decision Sciences · Psychology · #Advanced Bandit Algorithms Research #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Mental Health Research Topics #Receptor Mechanisms and Signaling
- Artificial Neural Networks for Magnetoencephalography: A review of an emerging field
2025/01/20 by Arthur Dehgan, Dehgan, Arthur, Hamza Abdelhedi +7 · 1 citation
Computer Science · Neuroscience · #EEG and Brain-Computer Interfaces #FOS: Biological sciences #Neural Networks and Applications #Neurons and Cognition (q-bio.NC)
- μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
2024/05/31 by Benjamin Therien, Thérien, Benjamin, C. Joseph +9 · 1 citation
Computer Science · Engineering · #Advanced Control Systems Optimization #FOS: Computer and information sciences #Fuzzy Logic and Control Systems #Machine Learning (cs.LG)
- Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Models
2025/08/03 by Istabrak Abbes, Abbes, Istabrak, Gopeshh Subbaraj +15 · 2 citations
Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- Relevant and Irrelevant: A Renormalization Group Analysis of Transformer Attention
2026/07/16 by Parviz Haggi-Mani, Irina Rish
#cs.LG