Manli Shu

1. Coercing LLMs to do and reveal (almost) anything
   2024/02/21 by Jonas Geiping, Alex Stein, Geiping, Jonas +9 · 1 voice · 14 citations
   #cs.LG #cs.CL #cs.CR
2. xGen-MM (BLIP-3): A Family of Open Large Multimodal Models
   2024/08/16 by Le Xue, Xue, Le, Manli Shu +57 · 32 citations
   Computer Science · #Speech and dialogue systems #Multi-Agent Systems and Negotiation
3. MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens
   2024/06/17 by Anas Awadalla, Awadalla, Anas, Le Xue +26 · 1 voice · 7 citations
   Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CV #cs.LG
4. Where do Models go Wrong? Parameter-Space Saliency Maps for\n Explainability
   2021/08/03 by Roman Levin, R. V. Levin, Manli Shu +10 · 1 voice · 1 citation
   Computer Science · #Explainable Artificial Intelligence (XAI) #Adversarial Robustness in Machine Learning #Machine Learning in Healthcare
5. Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Tasks
   2023/10/30 by Micah Goldblum, Goldblum, Micah, Hossein Souri +23 · 8 citations
   Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
6. Encoding Robustness to Image Style via Adversarial Feature Perturbations
   2020/09/18 by Manli Shu, Shu, Manli, Zuxuan Wu +5 · 3 citations
   Computer Science · #Advanced Image Processing Techniques #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG)
7. Shadowcast: Stealthy Data Poisoning Attacks Against Vision-Language Models
   2024/02/05 by Yuancheng Xu, Xu, Yuancheng, Jiarui Yao +13 · 5 citations
   Computer Science · Social Sciences · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Blockchain Technology Applications and Security #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Misinformation and Its Impacts
8. LATTE: Learning to Think with Vision Specialists
   2024/12/07 by Zixian Ma, Jianguo Zhang, Ma, Zixian +21 · 8 citations
   Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
9. Exploiting Sparsity for Long Context Inference: Million Token Contexts on Commodity GPUs
   2025/02/10 by Ryan Synk, Synk, Ryan, Monte Hoover +14 · 1 voice · 2 citations
   Computer Science · #Advanced Image and Video Retrieval Techniques #Image Retrieval and Classification Techniques #Advanced Neural Network Applications
10. xGen-MM-Vid (BLIP-3-Video): You Only Need 32 Tokens to Represent a Video Even in VLMs
    2024/10/21 by Michael S. Ryoo, Honglu Zhou, Ryoo, Michael S. +19 · 5 citations
    Computer Science · Engineering · Medicine · #Neural Networks and Reservoir Computing #Optical Coherence Tomography Applications #Retinal Imaging and Analysis
11. ProVision: Programmatically Scaling Vision-centric Instruction Data for Multimodal Language Models
    2024/12/09 by Jieyu Zhang, Zhang, Jieyu, Le Xue +25 · 4 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Speech and dialogue systems