vix.ing · top · new · best · stats · spec

Castro, Pablo Samuel

  1. Deep Reinforcement Learning at the Edge of the Statistical Precipice
    2021/08/30 by Rishabh Agarwal, Agarwal, Rishabh, Max Schwarzer +7 · 67 citations
    Computer Science · #Reinforcement Learning in Robotics #Evolutionary Algorithms and Applications #Advanced Multi-Objective Optimization Algorithms
  2. Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Tasks
    2023/06/24 by Maxime Chevalier-Boisvert, Bolun Dai, Chevalier-Boisvert, Maxime +15 · 42 citations
    Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Context-Aware Activity Recognition Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics
  3. Stop Regressing: Training Value Functions via Classification for Scalable Deep RL
    2024/03/06 by Jesse Farebrother, Jordi Orbay, Farebrother, Jesse +21 · 3 voices · 33 citations
    Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.AI #cs.LG #stat.ML
  4. Bigger, Better, Faster: Human-level Atari with human-level efficiency
    2023/05/30 by Max Schwarzer, Schwarzer, Max, Johan Obando-Ceron +10 · 1 voice · 27 citations
    Computer Science · #Anomaly Detection Techniques and Applications #Human Pose and Action Recognition #Reinforcement Learning in Robotics #cs.AI #cs.LG
  5. The Dormant Neuron Phenomenon in Deep Reinforcement Learning
    2023/02/24 by Ghada Sokar, Rishabh Agarwal, Sokar, Ghada +5 · 21 citations
    Neuroscience · Computer Science · #Neural dynamics and brain function #Reinforcement Learning in Robotics #Neural Networks and Applications
  6. Scalable methods for computing state similarity in deterministic Markov\n Decision Processes
    2019/11/21 by Pablo Samuel Castro, Castro, Pablo Samuel · 10 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Bayesian Modeling and Causal Inference #FOS: Computer and information sciences #Formal Methods in Verification #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms
  7. The State of Sparse Training in Deep Reinforcement Learning
    2022/06/17 by Laura Graesser, Graesser, Laura, Utku Evci +5 · 11 citations
    Computer Science · #Reinforcement Learning in Robotics #Domain Adaptation and Few-Shot Learning #Machine Learning and ELM
  8. Mixtures of Experts Unlock Parameter Scaling for Deep RL
    2024/02/13 by Johan Obando-Ceron, Ghada Sokar, Obando-Ceron, Johan +15 · 13 citations
    Computer Science · Physics and Astronomy · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and ELM #Model Reduction and Neural Networks
  9. Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learning
    2021/01/13 by Agarwal, Rishabh, Machado, Marlos C., Castro, Pablo Samuel +1 · 7 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  10. Methods for computing state similarity in Markov Decision Processes
    2012/06/27 by Norman Ferns, Ferns, Norman, Pablo Samuel Castro +5 · 4 citations
    Engineering · Computer Science · #Fault Detection and Control Systems #AI-based Problem Solving and Planning #Reinforcement Learning in Robotics
  11. A Comparative Analysis of Expected and Distributional Reinforcement\n Learning
    2019/01/30 by Clare Lyle, Pablo Samuel Castro, Lyle, Clare +3 · 4 citations
    Computer Science · #Advanced Multi-Objective Optimization Algorithms #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
  12. The Difficulty of Passive Learning in Deep Reinforcement Learning
    2021/10/26 by Georg Ostrovski, Ostrovski, Georg, Pablo Samuel Castro +3 · 1 voice · 4 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.LG
  13. MICo: Improved representations via sampling-based state similarity for Markov decision processes
    2021/06/03 by Pablo Samuel Castro, Castro, Pablo Samuel, Tyler Kastner +5 · 5 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Bayesian Modeling and Causal Inference #Data Stream Mining Techniques #FOS: Computer and information sciences #Fault Detection and Control Systems #Machine Learning (cs.LG) #Reinforcement Learning in Robotics
  14. Reincarnating Reinforcement Learning: Reusing Prior Computation to Accelerate Progress
    2022/06/03 by Agarwal, Rishabh, Schwarzer, Max, Castro, Pablo Samuel +2 · 5 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  15. In value-based deep reinforcement learning, a pruned network is a good network
    2024/02/19 by Johan Obando-Ceron, Aaron Courville, Obando-Ceron, Johan +3 · 1 voice · 7 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Reservoir Computing #cs.AI #cs.LG
  16. A density estimation perspective on learning from pairwise human preferences
    2023/11/23 by Vincent Dumoulin, Daniel D. Johnson, Dumoulin, Vincent +7 · 6 citations
    Computer Science · #Speech and dialogue systems #Topic Modeling #Natural Language Processing Techniques
  17. Revisiting Rainbow: Promoting more Insightful and Inclusive Deep\n Reinforcement Learning Research
    2020/11/20 by Johan Obando-Ceron, Pablo Samuel Castro, Obando-Ceron, Johan S. +1 · 4 citations
    Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Artificial Intelligence (cs.AI) #Data Stream Mining Techniques #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics
  18. Dopamine: A Research Framework for Deep Reinforcement Learning
    2018/12/14 by Castro, Pablo Samuel, Moitra, Subhodeep, Gelada, Carles +2 · 3 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  19. NAVIX: Scaling MiniGrid Environments with JAX
    2024/07/28 by Eduardo Pignatelli, Jarek Liesen, Pignatelli, Eduardo +9 · 6 citations
    Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia Communication and Technology #Peer-to-Peer Network Technologies
  20. Small batch deep reinforcement learning
    2023/10/05 by Johan Obando-Ceron, Marc G. Bellemare, Obando-Ceron, Johan +3 · 6 citations
    Engineering · Neuroscience · #Artificial Intelligence (cs.AI) #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #Machine Learning (cs.LG) #Muscle activation and electromyography studies
  21. A Geometric Perspective on Optimal Representations for Reinforcement Learning
    2019/01/31 by Bellemare, Marc G., Dabney, Will, Dadashi, Robert +6 · 2 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  22. Meta-World+: An Improved, Standardized, RL Benchmark
    2025/05/16 by Reginald McLean, Evangelos Chatzaroulas, McLean, Reginald +21 · 10 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Reinforcement Learning in Robotics
  23. Metrics and continuity in reinforcement learning
    2021/02/02 by Lan, Charline Le, Bellemare, Marc G., Castro, Pablo Samuel · 2 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  24. On the consistency of hyper-parameter selection in value-based deep reinforcement learning
    2024/06/25 by Johan Obando-Ceron, João G. M. Araújo, Obando-Ceron, Johan +5 · 1 voice · 5 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Scheduling and Optimization Algorithms #cs.AI #cs.LG
  25. A general class of surrogate functions for stable and efficient reinforcement learning
    2021/08/12 by Sharan Vaswani, Olivier Bachem, Vaswani, Sharan +15 · 2 citations
    Computer Science · Decision Sciences · #Adaptive Dynamic Programming Control #Advanced Bandit Algorithms Research #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
  26. Studying the Interplay Between the Actor and Critic Representations in Reinforcement Learning
    2025/03/08 by Garcin, Samuel, McInroe, Trevor, Castro, Pablo Samuel +4 · 7 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  27. Multi-Task Reinforcement Learning Enables Parameter Scaling
    2025/03/07 by Reginald McLean, McLean, Reginald, Evangelos Chatzaroulas +9 · 1 voice · 4 citations
    Engineering · #Digital Transformation in Industry #Scheduling and Optimization Algorithms #cs.AI #cs.LG
  28. Mixture of Experts in a Mixture of RL settings
    2024/06/26 by Timon Willi, Willi, Timon, Johan Obando-Ceron +7 · 3 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Bayesian Methods and Mixture Models #Distributed Sensor Networks and Detection Algorithms #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG)
  29. A Survey of State Representation Learning for Deep Reinforcement Learning
    2025/06/20 by Echchahed, Ayoub, Castro, Pablo Samuel · 5 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  30. Proto-Value Networks: Scaling Representation Learning with Auxiliary Tasks
    2023/04/25 by Jesse Farebrother, Joshua Greaves, Farebrother, Jesse +11 · 2 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
  31. Measure gradients, not activations! Enhancing neuronal activity in deep reinforcement learning
    2025/05/29 by Jiashun Liu, Zihao Wu, Liu, Jiashun +9 · 5 citations
    Neuroscience · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural dynamics and brain function #Neuroscience and Neural Engineering
  32. Stable Gradients for Stable Learning at Scale in Deep Reinforcement Learning
    2025/06/18 by Roger Creus Castanyer, Castanyer, Roger Creus, Johan Obando-Ceron +11 · 1 voice · 6 citations
    #cs.LG
  33. Mitigating Plasticity Loss in Continual Reinforcement Learning by Reducing Churn
    2025/05/31 by Hongyao Tang, Johan Obando-Ceron, Tang, Hongyao +7 · 4 citations
    Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Muscle activation and electromyography studies
  34. Don't flatten, tokenize! Unlocking the key to SoftMoE's efficacy in deep RL
    2024/10/02 by Ghada Sokar, Sokar, Ghada, Johan Obando-Ceron +7 · 2 citations
    Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG)
  35. JaxPruner: A concise library for sparsity research
    2023/04/27 by Lee, Joo Hyung, Park, Wonpyo, Mitchell, Nicole +22 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE)
  36. Asymmetric Proximal Policy Optimization: mini-critics boost LLM reasoning
    2025/10/02 by Johan Obando-Ceron, Liu, Jiashun, Obando-Ceron, Johan +16 · 3 citations
    Decision Sciences · #Artificial Intelligence (cs.AI) #Auction Theory and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG)
  37. CALE: Continuous Arcade Learning Environment
    2024/10/31 by Jesse Farebrother, Pablo Samuel Castro, Farebrother, Jesse +1 · 1 voice · 2 citations
    #cs.LG #cs.AI
  38. Mind the GAP! The Challenges of Scale in Pixel-based Deep Reinforcement Learning
    2025/05/23 by Ghada Sokar, Sokar, Ghada, Pablo Samuel Castro +1 · 3 voices · 1 citation
    #cs.LG #cs.AI
  39. Performing Structured Improvisations with pre-trained Deep Learning Models
    2019/04/30 by Pablo Samuel Castro, Castro, Pablo Samuel · 2 citations
    Computer Science · Neuroscience · #Music Technology and Sound Studies #Music and Audio Processing #Neuroscience and Music Perception
  40. The Impact of On-Policy Parallelized Data Collection on Deep Reinforcement Learning Networks
    2025/06/03 by Walter Mayor, Mayor, Walter, Johan Obando-Ceron +5 · 4 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Software-Defined Networks and 5G #Stochastic Gradient Optimization Techniques
  41. Continual Learning in Vision-Language Models via Aligned Model Merging
    2025/05/30 by Sokar, Ghada, Dziugaite, Gintare Karolina, Arnab, Anurag +3 · 2 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  42. Simplicial Embeddings Improve Sample Efficiency in Actor-Critic Agents
    2025/10/15 by Johan Obando-Ceron, Walter Mayor, Obando-Ceron, Johan +9 · 1 voice · 2 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multi-Agent Systems and Negotiation #Reinforcement Learning in Robotics #Robotics (cs.RO) #cs.AI #cs.LG #cs.RO
  43. Optimistic critics can empower small actors
    2025/06/01 by Mastikhina, Olya, Sreenivas, Dhruv, Castro, Pablo Samuel · 2 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)