Irina Rish
- Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interference
2018/10/28 by Matthew Riemer, Riemer, Matthew, Ignacio Cases +11 · 82 citations
Computer Science · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications
- Simple and Scalable Strategies to Continually Pre-train Large Language Models
2024/03/13 by Adam Ibrahim, Benjamin Thérien, Ibrahim, Adam +14 · 3 voices · 29 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- Towards Continual Reinforcement Learning: A Review and Perspectives
2020/12/25 by Khimya Khetarpal, Khetarpal, Khimya, Matthew Riemer +5 · 41 citations
Biochemistry, Genetics and Molecular Biology · #Viral Infectious Diseases and Gene Expression in Insects
- Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting
2023/10/12 by Kashif Rasul, Arjun Ashok, Rasul, Kashif +30 · 61 citations
Decision Sciences · Computer Science · #Stock Market Forecasting Methods #Time Series Analysis and Forecasting #Forecasting Techniques and Applications
- RedPajama: an Open Dataset for Training Large Language Models
2024/11/19 by Maurice Weber, Daniel Fu, Weber, Maurice +34 · 92 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalization
2021/06/11 by Kartik Ahuja, Ahuja, Kartik, Ethan Caballero +11 · 26 citations
Computer Science · #Adversarial Robustness in Machine Learning #Bayesian Modeling and Causal Inference #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms
- Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks
2015/11/19 by Pouya Bashivan, Irina Rish, Bashivan, Pouya +5 · 21 citations
Neuroscience · #EEG and Brain-Computer Interfaces #Neural dynamics and brain function #Neural and Behavioral Psychology Studies
- Context is Key: A Benchmark for Forecasting with Essential Textual Information
2024/10/24 by Andrew Williams, Williams, Andrew Robert, Arjun Ashok +19 · 27 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Semantic Web and Ontologies
- Continual Learning with Foundation Models: An Empirical Study of Latent Replay
2022/04/30 by Оleksiy Ostapenko, Timothée Lesort, Ostapenko, Oleksiy +11 · 9 citations
Computer Science · #Domain Adaptation and Few-Shot Learning
- Towards Scaling Difference Target Propagation by Learning Backprop Targets
2022/01/31 by Maxence Ernoult, Fabrice Normandin, Ernoult, Maxence +13 · 8 citations
Computer Science · Engineering · Neuroscience · #Advanced Memory and Neural Computing #FOS: Computer and information sciences #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE) #Neural dynamics and brain function
- MuLoCo: Muon is a practical inner optimizer for DiLoCo
2025/05/29 by Benjamin Thérien, Benjamin Therien, Xiaolong Huang +8 · 1 voice · 9 citations
Computer Science · Materials Science · #Big Data and Digital Economy #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Topic Modeling #cs.LG
- Spectra: Surprising Effectiveness of Pretraining Ternary Language Models at Scale
2024/07/17 by Ayush Kaushal, Tejas Vaidhya, Kaushal, Ayush +9 · 1 voice · 5 citations
Computer Science · #68T30 #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.6 #I.2.7 #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- A Survey on Practical Applications of Multi-Armed and Contextual Bandits
2019/04/02 by Djallel Bouneffouf, Irina Rish, Bouneffouf, Djallel +1 · 6 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Search Problems #Reinforcement Learning in Robotics
- LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot Compression
2023/09/25 by Ayush Kaushal, Tejas Vaidhya, Kaushal, Ayush +3 · 8 citations
Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computational Physics and Python Applications #FOS: Computer and information sciences #Parallel Computing and Optimization Techniques #Tensor decomposition and applications
- Continual Learning with Self-Organizing Maps
2019/04/19 by Pouya Bashivan, Bashivan, Pouya, Martin Schrimpf +9 · 4 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning and ELM #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE)
- Beyond Backprop: Online Alternating Minimization with Auxiliary Variables
2018/06/24 by Anna Choromanska, Benjamin Cowen, Choromanska, Anna +19 · 8 citations
Computer Science · #Stochastic Gradient Optimization Techniques #Machine Learning and ELM #Domain Adaptation and Few-Shot Learning
- Maximum State Entropy Exploration using Predecessor and Successor Representations
2023/06/26 by Arnav Jain, Lucas Lehnert, Jain, Arnav Kumar +5 · 5 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification #Reinforcement Learning in Robotics
- SAND-mask: An Enhanced Gradient Masking Strategy for the Discovery of Invariances in Domain Generalization
2021/06/04 by Soroosh Shahtalebi, Shahtalebi, Soroosh, Jean-Christophe Gagnon-Audet +9 · 4 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Understanding Continual Learning Settings with Data Distribution Drift Analysis
2021/04/04 by Timothée Lesort, Lesort, Timothée, M. Caccia +3 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Data Stream Mining Techniques #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Machine Learning and ELM
- Parametric Scattering Networks
2021/07/20 by Shanel Gauthier, Benjamin Therien, Gauthier, Shanel +13 · 3 citations
Computer Science · #F.2.2 #FOS: Computer and information sciences #FOS: Electrical engineering #Face and Expression Recognition #I.2.7 #Image and Signal Denoising Methods #Machine Learning (cs.LG) #Optical measurement and interference techniques #Signal Processing (eess.SP) #electronic engineering #information engineering
- Non-Adversarial Inverse Reinforcement Learning via Successor Feature Matching
2024/11/11 by Arnav Kumar Jain, Jain, Arnav Kumar, Harley Wiltzer +9 · 1 voice · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.LG
- Scaling Laws for the Few-Shot Adaptation of Pre-trained Image Classifiers
2021/10/13 by Gabriele Prato, Prato, Gabriele, Simon Guiroy +7 · 2 citations
Computer Science · Medicine · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Challenging Common Assumptions about Catastrophic Forgetting
2022/07/10 by Timothée Lesort, Lesort, Timothée, Оleksiy Ostapenko +11 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Gradient Masked Averaging for Federated Learning
2022/01/28 by Irene Tenison, Sai Aravind Sreeramadas, Tenison, Irene +9 · 2 citations
Computer Science · Mathematics · #Advanced Graph Neural Networks #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data #Statistical Methods and Inference
- A Survey on Compositional Generalization in Applications
2023/02/02 by Baihan Lin, Djallel Bouneffouf, Lin, Baihan +3 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Geochemistry and Geologic Mapping #Machine Learning (cs.LG) #Rough Sets and Fuzzy Logic #Symbolic Computation (cs.SC)
- Enabling Realtime Reinforcement Learning at Scale with Staggered Asynchronous Inference
2024/12/18 by Matthew Riemer, Riemer, Matthew, Gopeshh Subbaraj +5 · 4 citations
Computer Science · Engineering · #Neural Networks and Applications #Reinforcement Learning in Robotics #Analog and Mixed-Signal Circuit Design
- COVI White Paper
2020/05/18 by Hannah Alsdurf, Alsdurf, Hannah, Edmond Belliveau +45 · 1 citation
Computer Science · Mathematics · Medicine · #Artificial Intelligence (cs.AI) #COVID-19 Digital Contact Tracing #COVID-19 diagnosis using AI #COVID-19 epidemiological studies #Computers and Society (cs.CY) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences
- COVI-AgentSim: an Agent-based Model for Evaluating Methods of Digital Contact Tracing
2020/10/29 by Prateek K. Gupta, Tegan Maharaj, Gupta, Prateek +58 · 1 citation
Computer Science · Mathematics · Medicine · #COVID-19 Digital Contact Tracing #COVID-19 epidemiological studies #Computers and Society (cs.CY) #Data-Driven Disease Surveillance #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multiagent Systems (cs.MA) #Social and Information Networks (cs.SI)
- Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training
2025/03/04 by Vaibhav Singh, Paul Janson, Singh, Vaibhav +11 · 3 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms
- Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoning
2024/11/04 by Md Rifat Arefin, Gopeshh Subbaraj, Arefin, Md Rifat +11 · 2 citations
Computer Science · #AI-based Problem Solving and Planning #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Handling Delay in Real-Time Reinforcement Learning
2025/03/30 by Ivan Anokhin, Rishav Rishav, Anokhin, Ivan +9 · 3 citations
Computer Science · #Reinforcement Learning in Robotics #Advanced Neural Network Applications #Explainable Artificial Intelligence (XAI)
- μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
2024/05/31 by Benjamin Therien, Thérien, Benjamin, C. Joseph +9 · 2 citations
Computer Science · Engineering · #Advanced Control Systems Optimization #FOS: Computer and information sciences #Fuzzy Logic and Control Systems #Machine Learning (cs.LG)
- GitChameleon: Unmasking the Version-Switching Capabilities of Code Generation Models
2024/11/05 by Nizar Islah, Islah, Nizar, Justine Gehring +11 · 2 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model-Driven Software Engineering Techniques #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability
- Bandit Models of Human Behavior: Reward Processing in Mental Disorders
2017/06/07 by Djallel Bouneffouf, Bouneffouf, Djallel, Irina Rish +3 · 2 citations
Biochemistry, Genetics and Molecular Biology · Decision Sciences · Psychology · #Advanced Bandit Algorithms Research #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Mental Health Research Topics #Receptor Mechanisms and Signaling
- Artificial Neural Networks for Magnetoencephalography: A review of an emerging field
2025/01/20 by Arthur Dehgan, Dehgan, Arthur, Hamza Abdelhedi +7 · 1 citation
Computer Science · Neuroscience · #EEG and Brain-Computer Interfaces #FOS: Biological sciences #Neural Networks and Applications #Neurons and Cognition (q-bio.NC)
- Towards Adversarially Robust Vision-Language Models: Insights from Design Choices and Prompt Formatting Techniques
2024/07/15 by Rishika Bhagwatkar, Bhagwatkar, Rishika, Shravan Nayak +11 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Models
2025/08/03 by Istabrak Abbes, Gopeshh Subbaraj, Abbes, Istabrak +15 · 2 citations
Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- Relevant and Irrelevant: A Renormalization Group Analysis of Transformer Attention
2026/07/16 by Parviz Haggi-Mani, Irina Rish
#cs.LG