- Log-Linear Attention
2025/06/05 by Han Guo, Songlin Yang, Guo, Han +11 · 2 voices · 18 citations
Computer Science · #Context (archaeology) #Context model #Machine Learning in Healthcare #Parallel Computing and Optimization Techniques #Scalability #Sequence (biology) #Set (abstract data type) #Softmax function #State (computer science) #Topic Modeling #cs.LG
- Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformers
2025/05/31 by Kazuki Irie, Irie, Kazuki, Morris Yau +3 · 1 voice · 7 citations
Computer Science · Engineering · #Advanced Data Storage Technologies #Advanced Memory and Neural Computing #Artificial neural network #Computation #Hybrid system #Leverage (statistics) #Parallel Computing and Optimization Techniques #Reinforcement learning #Softmax function #Transformer
- Transformers as Support Vector Machines
2023/08/31 by Davoud Ataee Tarzanagh, Tarzanagh, Davoud Ataee, Yingcong Li +5 · 5 voices · 12 citations
Computer Science · Mathematics · #Algorithm #Applied mathematics #Artificial intelligence #Artificial neural network #Computer science #Deep learning #Discrete mathematics #Domain Adaptation and Few-Shot Learning #Equivalence (formal languages) #Gradient descent #Machine Learning and Data Classification #Mathematical optimization #Mathematics #Nonlinear system #Pairwise comparison #Parameterized complexity #Softmax function #Support vector machine #Topic Modeling #Transformer #Voltage
- A Deep Convolutional Neural Network for the Detection of Polyps in\n Colonoscopy Images
2020/08/15 by Tariq Rahim, Syed Ali Hassan, Rahim, Tariq +3 · 1 citation
Computer Science · Medicine · #Artificial intelligence #Colonoscopy #Colorectal Cancer Screening and Detection #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Computer vision #Convolutional neural network #Deep learning #FOS: Computer and information sciences #FOS: Electrical engineering #Feature extraction #Image (mathematics) #Image Retrieval and Classification Techniques #Image and Video Processing (eess.IV) #Image segmentation #Machine Learning (cs.LG) #Medicine #Pattern recognition (psychology) #Pixel #Softmax function #Sørensen–Dice coefficient #electronic engineering #information engineering
- On Universal Features for High-Dimensional Learning and Inference
2019/11/20 by Shao‐Lun Huang, Huang, Shao-Lun, Anuran Makur +5 · 2 citations
Computer Science · Mathematics · Physics and Astronomy · #Artificial intelligence #Artificial neural network #Canonical correlation #Cluster analysis #Computer science #Equivalence (formal languages) #FOS: Computer and information sciences #Inference #Information Theory (cs.IT) #Information bottleneck method #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine learning #Mathematics #Multinomial logistic regression #Neural Networks and Applications #Singular value decomposition #Softmax function #Statistical Mechanics and Entropy #Universality (dynamical systems)
- Island Loss for Learning Discriminative Features in Facial Expression Recognition
2017/10/09 by Jie Cai, Cai, Jie, Zibo Meng +9 · 1 citation
Computer Science · Psychology · Social Sciences · #Advanced Computing and Algorithms #Artificial intelligence #Benchmark (surveying) #Cartography #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Convolutional neural network #Discriminative model #Emotion and Mood Recognition #Expression (computer science) #FOS: Computer and information sciences #Face (sociological concept) #Face and Expression Recognition #Facial expression #Facial expression recognition #Facial recognition system #Geography #Pattern recognition (psychology) #Softmax function #Speech recognition
- ImageNet classification with deep convolutional neural networks
2017/05/24 by Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · 4961 citations
Computer Science · #Advanced Image Processing Techniques #Advanced Neural Network Applications #Artificial intelligence #Artificial neural network #Computer science #Convolution (computer science) #Convolutional neural network #Deep neural networks #Domain Adaptation and Few-Shot Learning #Dropout (neural networks) #Machine learning #Normalization (sociology) #Pattern recognition (psychology) #Pooling #Regularization (linguistics) #Softmax function #Word error rate
- A Mathematical Theory of Deep Convolutional Neural Networks for Feature\n Extraction
2015/12/19 by Thomas Wiatowski, Helmut Bölcskei, Wiatowski, Thomas +1 · 1 voice · 4 citations
Computer Science · Earth and Planetary Sciences · Mathematics · Physics and Astronomy · #Algorithm #Artificial intelligence #Computer science #Convolutional neural network #Feature extraction #Image and Signal Denoising Methods #Lipschitz continuity #Mathematical analysis #Mathematics #Model Reduction and Neural Networks #Pattern recognition (psychology) #Seismic Imaging and Inversion Techniques #Softmax function #Wavelet