- Autoregressive Distillation of Diffusion Transformers
2025/04/15 by Yeongmin Kim, Kim, Yeongmin, Sotiris Anagnostidis +15 · 3 citations
Computer Science · #Advanced Neural Network Applications #Autoregressive model #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FLOPS #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Ode #Rendering (computer graphics) #Scalability #Trajectory #Transformer
- Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
2023/05/23 by Hong Liu, Liu, Hong, Zhiyuan Li +8 · 7 voices · 68 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #Algorithm #Applied mathematics #Artificial intelligence #Clipping (morphology) #Computer science #Convexity #Diagonal #FLOPS #Geometry #Hessian matrix #Language model #Mathematical optimization #Mathematics #Natural Language Processing Techniques #Order (exchange) #Overhead (engineering) #Parallel computing #Perplexity #Scalability #Topic Modeling
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
2022/05/27 by Tri Dao, Daniel Y. Fu, Dao, Tri +7 · 8 voices · 1090 citations
Computer Science · #Advanced Neural Network Applications #Algorithm #Artificial intelligence #Computer science #Domain Adaptation and Few-Shot Learning #FLOPS #Language model #Machine Learning and Data Classification #Memory bandwidth #Parallel computing #Perplexity #Speedup #cs.LG
- Only Train Once: A One-Shot Neural Network Training And Pruning Framework
2021/07/15 by Tianyi Chen, Bo Ji, Chen, Tianyi +18 · 1 voice · 12 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #Algorithm #Artificial intelligence #Artificial neural network #Computer science #Deep neural networks #Domain Adaptation and Few-Shot Learning #FLOPS #Heuristic #Inference #Invariant (physics) #Machine learning #Mathematics #Parallel computing #Partition (number theory) #Pruning #Speedup #Stochastic Gradient Optimization Techniques
- EfficientPose: Efficient Human Pose Estimation with Neural Architecture Search
2020/12/13 by Wenqiang Zhang, Jiemin Fang, Zhang, Wenqiang +5 · 1 citation
Computer Science · Medicine · #Algorithm #Artificial intelligence #Artificial neural network #Computation #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Convolutional neural network #Diabetic Foot Ulcer Assessment and Management #FLOPS #FOS: Computer and information sciences #Human Pose and Action Recognition #Image (mathematics) #Machine learning #Network architecture #Parallel computing #Pose #Reuse #Task (project management) #Video Surveillance and Tracking Methods
- Ara: A 1-GHz+ Scalable and Energy-Efficient RISC-V Vector Processor With Multiprecision Floating-Point Support in 22-nm FD-SOI
2019/06/02 by Matheus Cavalcante, Fabian Schuiki, Florian Zaruba +2 · 2 voices · 9 citations
Computer Science · Engineering · Mathematics · #Algorithm #Computer science #Double-precision floating-point format #FLOPS #Floating point #Instruction set #Interconnection Networks and Systems #Linear algebra #Low-power high-performance VLSI design #Mathematics #Matrix (chemical analysis) #Matrix multiplication #Microarchitecture #Multiplication (music) #Parallel Computing and Optimization Techniques #Parallel computing #Physics #Reduced instruction set computing #Register file #SIMD #Scalability #Vector processor
- An efficient sparse-dense matrix multiplication on a multicore system
2017/10/01 by Di Yan, Tao Wu, Ying Liu +1 · 1 citation
Computer Science · #Parallel Computing and Optimization Techniques #Advanced Data Storage Technologies #Stochastic Gradient Optimization Techniques #Computer science #Sparse matrix #Speedup #Parallel computing #Matrix multiplication #Kernel (algebra) #Multi-core processor #Scalability #Block (permutation group theory) #FLOPS #Multiplication (music) #Computation #Computational science #Algorithm #Operating system
- Flip-flops of FK Comae Berenices
2012/11/30 by T. Hackman, Thomas Hackman, J. Pelt +15 · 1 citation
Agricultural and Biological Sciences · Biochemistry, Genetics and Molecular Biology · Engineering · Physics and Astronomy · #Astronomy #Astrophysics #FLOPS #Near-Field Optical Microscopy #Physics #RNA Interference and Gene Delivery #Research in Cotton Cultivation #astro-ph.SR
- A Superfast Toeplitz Solver with Improved Numerical Stability
2003/01/01 by Michael Stewart · 1 citation
Computer Science · Mathematics · #Matrix Theory and Algorithms #Advanced Topics in Algebra #Advanced Algebra and Geometry #Toeplitz matrix #Solver #Mathematics #FLOPS #Inverse #Matrix (chemical analysis) #Positive-definite matrix #Algorithm #Numerical stability #Block (permutation group theory) #Inversion (geology) #Divide and conquer algorithms #Applied mathematics #Combinatorics #Parallel computing #Numerical analysis #Computer science #Mathematical optimization #Pure mathematics #Mathematical analysis #Geometry #Eigenvalues and eigenvectors
- Machine organization of the IBM RISC System/6000 processor
1990/01/01 by Greg Grohoski · 1 citation
Computer Science · #Parallel Computing and Optimization Techniques #Numerical Methods and Algorithms #Distributed and Parallel Computing Systems #Computer science #Reduced instruction set computing #IBM #Operating system #Pipeline (software) #FLOPS #Instructions per cycle #Parallel computing #Superscalar #Embedded system #Floating-point unit #Instruction set #Floating point #Central processing unit