Ajay Jaiswal
- Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity
2023/10/08 by Lu Yin, Yin, Lu, You Wu +24 · 1 voice · 24 citations
Computer Science · #cs.LG
- LLaGA: Large Language and Graph Assistant
2024/02/13 by Runjin Chen, Chen, Runjin, Tong Zhao +6 · 34 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Semantic Web and Ontologies
- FarSight: A Physics-Driven Whole-Body Biometric System at Large Distance and Altitude
2023/06/29 by Feng Liu, Ryan Ashbaugh, Liu, Feng +37 · 1 voice · 4 citations
#cs.CV
- Decoding Compressed Trust: Scrutinizing the Trustworthiness of Efficient LLMs Under Compression
2024/03/18 by Junyuan Hong, Hong, Junyuan, Jinhao Duan +27 · 10 citations
Computer Science · #Advanced Data Storage Technologies #Artificial Intelligence (cs.AI) #Blockchain Technology Applications and Security #Computation and Language (cs.CL) #Cryptography and Data Security #FOS: Computer and information sciences
- Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers
2023/03/02 by Tianlong Chen, Chen, Tianlong, Zhenyu Zhang +7 · 7 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and ELM #Multimodal Machine Learning Applications
- Physics-Driven Turbulence Image Restoration with Stochastic Refinement
2023/07/20 by Ajay Jaiswal, Xingguang Zhang, Jaiswal, Ajay +5 · 5 citations
Computer Science · Physics and Astronomy · #Adaptive optics and wavefront sensing #Advanced Image Processing Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image Enhancement Techniques #Image and Video Processing (eess.IV) #electronic engineering #information engineering
- Is C4 Dataset Optimal for Pruning? An Investigation of Calibration Data for LLM Pruning
2024/10/09 by Abhinav Bandari, Bandari, Abhinav, Lu Yin +13 · 6 citations
Engineering · #Advanced Surface Polishing Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Metallurgical Processes and Thermodynamics #Mineral Processing and Grinding
- Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation
2023/04/28 by Wenqing Zheng, Zheng, Wenqing, S P Sharan +11 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Programming Languages (cs.PL) #Software Engineering Research #Topic Modeling
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients
2024/07/11 by Zhenyu Zhang, Zhang, Zhenyu, Ajay Jaiswal +11 · 3 citations
Engineering · Materials Science · Physics and Astronomy · #FOS: Computer and information sciences #Ga2O3 and related materials #GaN-based semiconductor devices and materials #Machine Learning (cs.LG) #Semiconductor materials and devices
- SCALP -- Supervised Contrastive Learning for Cardiopulmonary Disease Classification and Localization in Chest X-rays using Patient Metadata
2021/10/27 by Ajay Jaiswal, Jaiswal, Ajay, Tianhao Li +11 · 1 citation
Medicine · #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Lung Cancer Diagnosis and Treatment #Radiomics and Machine Learning in Medical Imaging #electronic engineering #information engineering
- From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories, and Applications
2024/07/15 by Ajay Jaiswal, Jaiswal, Ajay, Lu Yin +12 · 2 citations
Materials Science · Engineering · #Ga2O3 and related materials #Plasma Diagnostics and Applications #High voltage insulation and dielectric phenomena
- Training Your Sparse Neural Network Better with Any Mask
2022/06/26 by Ajay Jaiswal, Haoyu Ma, Jaiswal, Ajay +7 · 1 citation
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition
- Old can be Gold: Better Gradient Flow can Make Vanilla-GCNs Great Again
2022/10/14 by Ajay Jaiswal, Jaiswal, Ajay, Peihao Wang +8 · 1 citation
Computer Science · Neuroscience · #Advanced Graph Neural Networks #Brain Tumor Detection and Classification #FOS: Computer and information sciences #Machine Learning (cs.LG) #Social and Information Networks (cs.SI)
- The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Matter
2023/06/06 by Ajay Jaiswal, Jaiswal, Ajay, Shiwei Liu +5 · 1 citation
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Speech Recognition and Synthesis #Topic Modeling
- FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping
2024/04/05 by Ajay Jaiswal, Jaiswal, Ajay, Bodun Hu +11 · 1 citation
Computer Science · #Algorithms and Data Compression #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Sebra: Debiasing Through Self-Guided Bias Ranking
2025/01/30 by Adarsh Kappiyath, Kappiyath, Adarsh, Chaudhuri, Abhra +9 · 1 citation
Computer Science · Social Sciences · #Mobile Crowdsensing and Crowdsourcing #Ethics and Social Impacts of AI #Domain Adaptation and Few-Shot Learning