Saining Xie
- A ConvNet for the 2020s
2022/01/10 by Zhuang Liu, Hanzi Mao, Liu, Zhuang +9 · 4 voices · 392 citations
Computer Science · Medicine · #Advanced Neural Network Applications #COVID-19 diagnosis using AI #Domain Adaptation and Few-Shot Learning #cs.CV
- Masked Autoencoders Are Scalable Vision Learners
2021/11/11 by Kaiming He, He, Kaiming, Xinlei Chen +9 · 4 voices · 769 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #cs.CV
- V*: Guided Visual Search as a Core Mechanism in Multimodal LLMs
2023/12/21 by Penghao Wu, Wu, Penghao, Saining Xie +1 · 2 voices · 132 citations
Computer Science · #Multimodal Machine Learning Applications #Semantic Web and Ontologies #Image Retrieval and Classification Techniques
- Scalable Diffusion Models with Transformers
2022/12/19 by William Peebles, Peebles, William, Saining Xie +1 · 1173 citations
Medicine · Computer Science · #Advanced Neuroimaging Techniques and Applications #Generative Adversarial Networks and Image Synthesis #Music and Audio Processing
- SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
2025/01/28 by Tianzhe Chu, Yuexiang Zhai, Chu, Tianzhe +15 · 7 voices · 220 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Domain Adaptation and Few-Shot Learning
- Momentum Contrast for Unsupervised Visual Representation Learning
2019/11/13 by Kaiming He, He, Kaiming, Haoqi Fan +7 · 507 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Advanced Neural Network Applications
- Momentum Contrast for Unsupervised Visual Representation Learning
2020/06/01 by Kaiming He, Haoqi Fan, Yuxin Wu +2 · 484 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications
- Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think
2024/10/09 by Sihyun Yu, Yu, Sihyun, Sangkyung Kwak +11 · 2 voices · 169 citations
Computer Science · #Reinforcement Learning in Robotics
- Transfer between Modalities with MetaQueries
2025/04/08 by Xichen Pan, Satya Narayan Shukla, Pan, Xichen +24 · 7 voices · 83 citations
Computer Science · #Multimodal Machine Learning Applications #Generative Adversarial Networks and Image Synthesis #Domain Adaptation and Few-Shot Learning
- A ConvNet for the 2020s
2022/06/01 by Zhuang Liu, Hanzi Mao, Chao-Yuan Wu +3 · 248 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning
- Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs
2024/06/24 by Shengbang Tong, Tong, Shengbang, Ellis Brown +26 · 2 voices · 149 citations
Computer Science · #Advanced Computational Techniques and Applications #cs.CV
- SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers
2024/01/16 by Nanye Ma, Ma, Nanye, Michael S. Albergo +8 · 157 citations
Computer Science · Physics and Astronomy · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Music and Audio Processing
- ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoders
2023/01/02 by Sanghyun Woo, Woo, Sanghyun, Shoubhik Debnath +11 · 107 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces
2024/12/18 by Jihan Yang, Shusheng Yang, Yang, Jihan +10 · 1 voice · 172 citations
Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #cs.CV
- Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs
2024/01/11 by Shengbang Tong, Zhuang Liu, Tong, Shengbang +9 · 122 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Holistically-Nested Edge Detection
2015/04/24 by Saining Xie, Zhuowen Tu, Xie, Saining +1 · 54 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image and Object Detection Techniques #Medical Image Segmentation Techniques
- LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?
2025/06/13 by Zihan Zheng, Zheng, Zihan, Zerui Cheng +35 · 8 voices · 16 citations
#cs.SE #cs.AI #cs.CL #cs.LG
- Deeply-Supervised Nets
2014/09/18 by Chen‐Yu Lee, Saining Xie, Lee, Chen-Yu +7 · 40 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE)
- MetaMorph: Multimodal Understanding and Generation via Instruction Tuning
2024/12/18 by Shengbang Tong, David Fan, Tong, Shengbang +17 · 5 voices · 58 citations
#cs.CV
- PointContrast: Unsupervised Pre-training for 3D Point Cloud Understanding
2020/07/21 by Saining Xie, Jiatao Gu, Xie, Saining +9 · 29 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition
- SLIP: Self-supervision meets Language-Image Pre-training
2021/12/23 by Norman Mu, Alexander M. Kirillov, Mu, Norman +5 · 30 citations
Computer Science · Medicine · #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification
2017/12/13 by Saining Xie, Xie, Saining, Chen Sun +7 · 21 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Surveillance and Tracking Methods
- Demystifying CLIP Data
2023/09/28 by Xu Hu, Saining Xie, Xu, Hu +17 · 39 citations
Computer Science · Medicine · #COVID-19 diagnosis using AI #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Radiomics and Machine Learning in Medical Imaging
- Scaling Language-Free Visual Representation Learning
2025/04/01 by David Fan, Fan, David, Shengbang Tong +19 · 3 voices · 22 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #cs.CV
- Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps
2025/01/16 by Nanye Ma, Shangyuan Tong, Ma, Nanye +19 · 59 citations
Physics and Astronomy · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Model Reduction and Neural Networks
- Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
2024/05/16 by Yuexiang Zhai, Zhai, Yuexiang, Hao Bai +19 · 34 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Exploring Randomly Wired Neural Networks for Image Recognition
2019/04/02 by Saining Xie, Alexander Kirillov, Xie, Saining +5 · 1 voice · 4 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.CV #cs.LG
- AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
2024/10/04 by Wenhao Chai, Enxin Song, Chai, Wenhao +15 · 32 citations
Computer Science · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Video Analysis and Summarization
- Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts
2020/12/16 by Ji Hou, Benjamin Graham, Hou, Ji +5 · 10 citations
Earth and Planetary Sciences · Engineering · #3D Shape Modeling and Analysis #3D Surveying and Cultural Heritage #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics and Sensor-Based Localization
- Deconstructing Denoising Diffusion Models for Self-Supervised Learning
2024/01/25 by Xinlei Chen, Chen, Xinlei, Zhuang Liu +5 · 15 citations
Computer Science · #Image and Signal Denoising Methods
- On Interaction Between Augmentations and Corruptions in Natural Corruption Robustness
2021/02/22 by Eric Mintun, Mintun, Eric, Alexander Kirillov +3 · 8 citations
Computer Science · Medicine · #Domain Adaptation and Few-Shot Learning #Adversarial Robustness in Machine Learning #COVID-19 diagnosis using AI
- FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions
2020/04/12 by Alvin Wan, Wan, Alvin, Xiaoliang Dai +21 · 7 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE)
- Diffusion Transformers with Representation Autoencoders
2025/10/13 by Boyang Zheng, Nanye Ma, Zheng, Boyang +5 · 1 voice · 44 citations
#cs.CV #cs.LG
- MindCube: Spatial Mental Modeling from Limited Views
2025/06/26 by Yin, Baiqiao, Wang, Qineng, Pingyue Zhang +20 · 34 citations
Computer Science · Engineering · Social Sciences · #Artificial Intelligence (cs.AI) #Cognitive Science and Mapping #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Geographic Information Systems Studies #Spatial Cognition and Navigation
- On Scaling Up 3D Gaussian Splatting Training
2024/06/26 by Hexu Zhao, Zhao, Hexu, Haoyang Weng +11 · 14 citations
Biochemistry, Genetics and Molecular Biology · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #I.4.5 #Spectroscopy Techniques in Biomedical and Chemical Research
- Image Sculpting: Precise Object Editing with 3D Geometry Control
2024/01/02 by Jiraphon Yenphraphai, Xichen Pan, Yenphraphai, Jiraphon +7 · 9 citations
Computer Science · #Augmented Reality Applications #Advanced Image and Video Retrieval Techniques #Interactive and Immersive Displays
- DiffusionGuard: A Robust Defense Against Malicious Diffusion-based Image Editing
2024/10/08 by June Suk Choi, Kyungmin Lee, Choi, June Suk +9 · 7 citations
Computer Science · #Advanced Steganography and Watermarking Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face recognition and analysis #Generative Adversarial Networks and Image Synthesis
- Meta CLIP 2: A Worldwide Scaling Recipe
2025/07/29 by Yung-Sung Chuang, Li Yang, Chuang, Yung-Sung +27 · 15 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- Exploring Long-Sequence Masked Autoencoders
2022/10/13 by Ronghang Hu, Hu, Ronghang, Shoubhik Debnath +5 · 3 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications
- Altogether: Image Captioning via Re-aligning Alt-text
2024/10/22 by Hu Xu, Xu, Hu, Po-Yao Huang +23 · 6 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Video Analysis and Summarization
- Pri3D: Can 3D Priors Help 2D Representation Learning?
2021/04/22 by Ji Hou, Hou, Ji, Saining Xie +7 · 3 citations
Computer Science · Earth and Planetary Sciences · Engineering · #3D Shape Modeling and Analysis #3D Surveying and Cultural Heritage #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition
- Are Labels Necessary for Neural Architecture Search?
2020/03/26 by Chenxi Liu, Piotr Dollár, Liu, Chenxi +9 · 2 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
- Cambrian-S: Towards Spatial Supersensing in Video
2025/11/06 by Shusheng Yang, Yang, Shusheng, Jihan Yang +23 · 14 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Fast Encoding and Decoding for Implicit Video Representation
2024/09/28 by Hao Chen, Chen, Hao, Saining Xie +5 · 2 citations
Computer Science · #Advanced Vision and Imaging #Video Coding and Compression Technologies #Advanced Data Compression Techniques
- Traveling Across Languages: Benchmarking Cross-Lingual Consistency in Multimodal LLMs
2025/05/21 by Hao Wang, P.W. Huang, Wang, Hao +7 · 2 citations
Arts and Humanities · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Translation Studies and Practices #linguistics and terminology studies