SVD Based Least Squares for X-Ray Pneumonia Classification Using Deep Features

2025/04/29 by Erdogan, Mete, Sebnem Demirtas, Demirtas, Sebnem
Medicine · Computer Science · #COVID-19 diagnosis using AI #Domain Adaptation and Few-Shot Learning #AI in cancer detection

paper · pdf · doi:10.48550/arxiv.2504.20970

Abstract

Accurate and early diagnosis of pneumonia through X-ray imaging is essential for effective treatment and improved patient outcomes. Recent advancements in machine learning have enabled automated diagnostic tools that assist radiologists in making more reliable and efficient decisions. In this work, we propose a Singular Value Decomposition-based Least Squares (SVD-LS) framework for multi-class pneumonia classification, leveraging powerful feature representations from state-of-the-art self-supervised and transfer learning models. Rather than relying on computationally expensive gradient-based fine-tuning, we employ a closed-form, non-iterative classification approach that ensures efficiency without compromising accuracy. Experimental results demonstrate that SVD-LS achieves competitive performance while offering significantly reduced computational costs, making it a viable alternative for real-time medical imaging applications. The implementation is available at: github.com/meterdogan07/SVD-LS.

Citations

• Efficient Large Language Model Inference with Neural Block Linearization
• Error Broadcast and Decorrelation as a Potential Artificial and Natural Learning Mechanism
• Emerging Properties in Self-Supervised Vision Transformers
• Big Self-Supervised Models Advance Medical Image Classification
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• A Simple Framework for Contrastive Learning of Visual Representations
• Momentum Contrast for Unsupervised Visual Representation Learning
• Momentum Contrast for Unsupervised Visual Representation Learning
• EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
• A Survey on Deep Transfer Learning
• Deep Residual Learning for Image Recognition
• Adam: A Method for Stochastic Optimization
• Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions
• Backpropagation Applied to Handwritten Zip Code Recognition
• Optimal Filtering
• A New Approach to Linear Filtering and Prediction Problems
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Related

• Early Diagnosis of Pneumonia with Deep Learning
• Diagnosis of Patients with Viral, Bacterial, and Non-Pneumonia Based on Chest X-Ray Images Using Convolutional Neural Networks
• Explainable Lung Disease Classification from Chest X-Ray Images Utilizing Deep Learning and XAI
• Deep Pneumonia: Attention-Based Contrastive Learning for Class-Imbalanced Pneumonia Lesion Recognition in Chest X-rays
• LightPneumoNet: Lightweight Pneumonia Classifier