Khona, Mikail
- Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle
2023/03/24 by Rylan Schaeffer, Schaeffer, Rylan, Mikail Khona +13 · 4 voices · 4 citations
#cs.LG #stat.ML
- Pretraining Large Language Models with NVFP4
2025/09/29 by Felix Abecassis, NVIDIA, Abecassis, Felix +189 · 4 voices · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- Attractor and integrator networks in the brain
2021/12/07 by Khona, Mikail, Fiete, Ila R. · 22 citations
#FOS: Biological sciences #Neurons and Cognition (q-bio.NC)
- Self-Supervised Learning of Representations for Space Generates Multi-Modular Grid Cells
2023/11/04 by Rylan Schaeffer, Mikail Khona, Schaeffer, Rylan +9 · 5 citations
Biochemistry, Genetics and Molecular Biology · Neuroscience · #Single-cell and spatial transcriptomics #Cell Image Analysis Techniques #Neural dynamics and brain function
- Winning the lottery with neural connectivity constraints: faster learning across cognitive tasks with spatially constrained sparse RNNs
2022/07/07 by Mikail Khona, Sarthak Chandra, Khona, Mikail +5 · 2 citations
Computer Science · Engineering · Neuroscience · #Advanced Memory and Neural Computing #FOS: Biological sciences #Neural Networks and Applications #Neural dynamics and brain function #Neurons and Cognition (q-bio.NC)
- Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks
2023/11/21 by Rahul Ramesh, Ekdeep Singh Lubana, Ramesh, Rahul +7 · 2 citations
Computer Science · Psychology · #AI in Service Interactions #FOS: Computer and information sciences #Human-Automation Interaction and Safety #Machine Learning (cs.LG) #Speech and dialogue systems
- NVIDIA Nemotron 3: Efficient and Open Intelligence
2025/12/24 by NVIDIA, :, Aaron Blakeman +453 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing
2024/10/22 by Kento Nishi, Rahul Ramesh, Nishi, Kento +9 · 2 citations
Computer Science · #FOS: Computer and information sciences #Image Processing and 3D Reconstruction #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Semantic Web and Ontologies
- Towards an Understanding of Stepwise Inference in Transformers: A Synthetic Graph Navigation Model
2024/02/12 by Khona, Mikail, Okawa, Maya, Hula, Jan +5 · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Bridging Associative Memory and Probabilistic Modeling
2024/02/15 by Rylan Schaeffer, Schaeffer, Rylan, Nika Zahedi +21 · 1 citation
Computer Science · #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG)
- Uncovering Latent Memories: Assessing Data Leakage and Memorization Patterns in Frontier AI Models
2024/06/20 by Duan, Sunny, Khona, Mikail, Iyer, Abhiram +2 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Biological sciences #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neurons and Cognition (q-bio.NC)