Kumbong, Hermann

1. The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry
   2024/02/06 by M Zhang, K. Bhatia, Zhang, Michael +5 · 18 citations
   Mathematics · Psychology · #Cognitive and developmental aspects of mathematical skills #Child and Animal Learning Development
2. Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions
   2023/10/28 by Stefano Massaroli, Massaroli, Stefano, Michael Poli +23 · 5 citations
   Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Signal Processing (eess.SP) #Topic Modeling #electronic engineering #information engineering
3. FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
   2023/11/10 by Daniel Y. Fu, Hermann Kumbong, Fu, Daniel Y. +5 · 4 citations
   Biochemistry, Genetics and Molecular Biology · #Cancer-related molecular mechanisms research #FOS: Computer and information sciences #Genomics and Phylogenetic Studies #Machine Learning (cs.LG) #Machine Learning in Bioinformatics
4. HMAR: Efficient Hierarchical Masked Auto-Regressive Image Generation
   2025/06/04 by Hermann Kumbong, Kumbong, Hermann, Xian Liu +14 · 6 citations
   Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Cell Image Analysis Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG)
5. LowRA: Accurate and Efficient LoRA Fine-Tuning of LLMs under 2 Bits
   2025/02/12 by Zhou, Zikai, Zhang, Qizheng, Kumbong, Hermann +1 · 1 citation
   #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Performance (cs.PF)