Kevin Lin
- The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)
2023/09/29 by Zhengyuan Yang, Linjie Li, Yang, Zhengyuan +11 · 11 voices · 70 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Lost in the Middle: How Language Models Use Long Contexts
2023/07/06 by Nelson F. Liu, Liu, Nelson F., Kevin Lin +12 · 10 voices · 596 citations
Computer Science · #Advanced Graph Neural Networks #Natural Language Processing Techniques #Topic Modeling #cs.CL
- GIT: A Generative Image-to-text Transformer for Vision and Language
2022/05/27 by Jianfeng Wang, Wang, Jianfeng, Zhengyuan Yang +15 · 2 voices · 47 citations
Computer Science · #Handwritten Text Recognition Techniques #Multimodal Machine Learning Applications #Natural Language Processing Techniques #cs.CV
- MemGPT: Towards LLMs as Operating Systems
2023/10/12 by Charles Packer, Sarah Wooders, Packer, Charles +11 · 11 voices · 170 citations
#cs.AI
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities
2023/08/04 by Weihao Yu, Yu, Weihao, Zhengyuan Yang +13 · 183 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Multi-Stage Learning for Grasp-Constrained Object Manipulation with a Simulated Panda Robot
2020/09/25 by Yuke Zhu, Josiah Wong, Zhu, Yuke +15 · 80 citations
Computer Science · Engineering · #Reinforcement Learning in Robotics #Modular Robots and Swarm Intelligence #Robot Manipulation and Learning
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
2025/03/18 by Nvidia Nvidia, NVIDIA, : +80 · 260 citations
Engineering · Computer Science · #Robotic Locomotion and Control #Robotic Path Planning Algorithms #Reinforcement Learning in Robotics
- Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
2023/06/26 by Fuxiao Liu, Kevin Lin, Liu, Fuxiao +9 · 67 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computational Engineering #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Finance #Multimedia (cs.MM) #Multimodal Machine Learning Applications #and Science (cs.CE)
- MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action
2023/03/20 by Zhengyuan Yang, Linjie Li, Yang, Zhengyuan +16 · 58 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming
2025/01/31 by Mrinank Sharma, Sharma, Mrinank, Meg Tong +89 · 8 voices · 36 citations
Social Sciences · #Criminal Law and Evidence #Law, Rights, and Freedoms #Legal Systems and Judicial Processes
- Sleep-time Compute: Beyond Inference Scaling at Test-time
2025/04/17 by Kevin Lin, Charlie Snell, Lin, Kevin +11 · 3 voices · 4 citations
#cs.AI #cs.CL
- GenXD: Generating Any 3D and 4D Scenes
2024/11/04 by Yuyang Zhao, Chung-Ching Lin, Zhao, Yuyang +15 · 1 voice · 17 citations
#cs.CV #cs.AI
- DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning
2024/10/31 by Zhenyu Jiang, Yuqi Xie, Jiang, Zhenyu +13 · 47 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mechanics and Biomechanics Studies #Robot Manipulation and Learning #Robotics (cs.RO) #Virtual Reality Applications and Impacts
- End-to-End Human Pose and Mesh Reconstruction with Transformers
2020/12/17 by Kevin Lin, Lin, Kevin, Lijuan Wang +3 · 19 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition
- Mesh Graphormer
2021/04/01 by Kevin Lin, Lin, Kevin, Lijuan Wang +3 · 15 citations
Computer Science · Engineering · #Human Pose and Action Recognition #3D Shape Modeling and Analysis #Video Surveillance and Tracking Methods
- ReCo: Region-Controlled Text-to-Image Generation
2022/11/23 by Zhengyuan Yang, Yang, Zhengyuan, Jianfeng Wang +19 · 18 citations
Computer Science · #Multimodal Machine Learning Applications #Image Retrieval and Classification Techniques #Generative Adversarial Networks and Image Synthesis
- GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigation
2023/11/13 by An Yan, Yan, An, Zhengyuan Yang +21 · 18 citations
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Social Robot Interaction and HRI
- SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement
2025/04/10 by Xiyao Wang, Wang, Xiyao, Zhengyuan Yang +15 · 40 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning and Data Classification #Multimodal Machine Learning Applications
- MM-Vet v2: A Challenging Benchmark to Evaluate Large Multimodal Models for Integrated Capabilities
2024/08/01 by Weihao Yu, Yu, Weihao, Zhengyuan Yang +17 · 17 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Speech and dialogue systems
- Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillation
2024/06/11 by Yuanhao Zhai, Kevin Lin, Zhai, Yuanhao +15 · 11 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image and Video Quality Assessment
- Reasoning Over Paragraph Effects in Situations
2019/08/16 by Kevin Lin, Lin, Kevin, Oyvind Tafjord +5 · 5 citations
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- An Empirical Study of Multimodal Model Merging
2023/04/28 by Yi-Lin Sung, Sung, Yi-Lin, Linjie Li +9 · 6 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Domain Adaptation and Few-Shot Learning
- MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos
2024/06/12 by Xuehai He, Weixi Feng, He, Xuehai +25 · 9 citations
Computer Science · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Video Surveillance and Tracking Methods
- MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning
2023/11/29 by Chaoyi Zhang, Zhang, Chaoyi, Kevin Lin +13 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Music and Audio Processing #Natural Language Processing Techniques #Video Analysis and Summarization
- Grammar-based Neural Text-to-SQL Generation
2019/05/30 by Kevin Lin, Lin, Kevin, Ben Bogin +7 · 5 citations
Computer Science · Decision Sciences · #Topic Modeling #Natural Language Processing Techniques #Scientific Computing and Data Management
- List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
2024/04/25 by Yan An, Zhengyuan Yang, Yan, An +19 · 7 citations
Arts and Humanities · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Lexicography and Language Studies #Natural Language Processing Techniques #Semantic Web and Ontologies
- QuaRTz: An Open-Domain Dataset of Qualitative Relationship Questions
2019/09/08 by Oyvind Tafjord, Matt Gardner, Tafjord, Oyvind +5 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- PI3K/AKT/mTOR signaling transduction pathway and targeted therapies in cancer
2023/08/18 by Antonino Glaviano, Aaron Song Chuan Foo, Hiu Yan Lam +24 · 5 citations
Biochemistry, Genetics and Molecular Biology · Medicine · #Advanced Breast Cancer Therapies #Cancer Mechanisms and Therapy #PI3K/AKT/mTOR signaling in cancer
- An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling
2022/09/04 by Tsu-Jui Fu, Fu, Tsu-Jui, Linjie Li +11 · 4 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning
- Bias-adjusted spectral clustering in multi-layer stochastic block models
2020/03/18 by Kevin Lin, Lei, Jing, Lin, Kevin Z. · 3 citations
Physics and Astronomy · Neuroscience · Medicine · #Complex Network Analysis Techniques #Functional Brain Connectivity Studies #Advanced Neuroimaging Techniques and Applications
- Decomposing Complex Queries for Tip-of-the-tongue Retrieval
2023/05/24 by Kevin Lin, Lin, Kevin, Kyle Lo +5 · 2 voices · 3 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications #cs.CL #cs.IR
- Control Theory and Experimental Design in Diffusion Processes
2012/10/13 by Giles Hooker, Kevin Lin, Hooker, Giles +3 · 2 citations
Biochemistry, Genetics and Molecular Biology · Neuroscience · Physics and Astronomy · #FOS: Computer and information sciences #Gene Regulatory Network Analysis #Methodology (stat.ME) #Neural dynamics and brain function #stochastic dynamics and bifurcation
- SlowFast-VGen: Slow-Fast Learning for Action-Driven Long Video Generation
2024/10/30 by Yining Hong, Baiyu Liu, Hong, Yining +21 · 7 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Cell Image Analysis Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Robotics (cs.RO)
- Idea2Img: Iterative Self-Refinement with GPT-4V(ision) for Automatic Image Design and Generation
2023/10/12 by Zhengyuan Yang, Jianfeng Wang, Yang, Zhengyuan +11 · 4 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Tuning Timestep-Distilled Diffusion Model Using Pairwise Sample Optimization
2024/10/04 by Zichen Miao, Zhengyuan Yang, Miao, Zichen +11 · 6 citations
Computer Science · #Neural Networks and Applications
- EditRoom: LLM-parameterized Graph Diffusion for Composable 3D Room Layout Editing
2024/10/03 by Xiaotong Chen, Zheng, Kaizhi, Chen, Xiaotong +16 · 6 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Artificial Intelligence (cs.AI) #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graph Theory and Algorithms #Graphics (cs.GR) #Human-Computer Interaction (cs.HC)
- Audio-Aware Large Language Models as Judges for Speaking Styles
2025/06/06 by Cheng-Han Chiang, Chiang, Cheng-Han, Xiaofei Wang +18 · 10 citations
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #Emotion and Mood Recognition #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Speech Recognition and Synthesis #electronic engineering #information engineering
- ViCrit: A Verifiable Reinforcement Learning Proxy Task for Visual Perception in VLMs
2025/06/11 by Xiyao Wang, Wang, Xiyao, Zhengyuan Yang +22 · 11 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- COSMO: COntrastive Streamlined MultimOdal Model with Interleaved Pre-Training
2024/01/01 by Alex Jinpeng Wang, Wang, Alex Jinpeng, Linjie Li +13 · 3 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Point-RFT: Improving Multimodal Reasoning with Visually Grounded Reinforcement Finetuning
2025/05/26 by Minheng Ni, Ni, Minheng, Zhengyuan Yang +11 · 10 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Semantic Web and Ontologies #Speech and dialogue systems
- Proof of the geometric Langlands conjecture IV: ambidexterity
2024/09/13 by D. Arinkin, Dario Beraldo, Arinkin, D. +13 · 4 citations
Mathematics · Physics and Astronomy · #Advanced Algebra and Geometry #Advanced Differential Geometry Research #Algebraic Geometry (math.AG) #FOS: Mathematics #Geometric Analysis and Curvature Flows
- CLARINET: Augmenting Language Models to Ask Clarification Questions for Retrieval
2024/04/28 by Yizhou Chi, Chi, Yizhou, Jessy Lin +5 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Natural Language Processing Techniques #Topic Modeling
- Evaluating Models' Local Decision Boundaries via Contrast Sets
2020/04/06 by Matt Gardner, Gardner, Matt, Yoav Artzi +49 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Code Interviews: Design and Evaluation of a More Authentic Assessment for Introductory Programming Assignments
2024/10/01 by Suhas Kannam, Kannam, Suhas, Yingying Yang +5 · 2 citations
Computer Science · Engineering · #Computers and Society (cs.CY) #Experimental Learning in Engineering #FOS: Computer and information sciences #Information Systems Education and Curriculum Development #K.3.2 #Teaching and Learning Programming
- MPT: Mesh Pre-Training with Transformers for Human Pose and Mesh Reconstruction
2022/11/24 by Kevin Lin, Lin, Kevin, Chung-Ching Lin +6 · 1 citation
Computer Science · Medicine · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Diabetic Foot Ulcer Assessment and Management #FOS: Computer and information sciences #Human Pose and Action Recognition
- Adaptive Human Matting for Dynamic Videos
2023/04/12 by Chung-Ching Lin, Lin, Chung-Ching, Jiang Wang +11 · 1 citation
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Image Enhancement Techniques #Visual Attention and Saliency Detection
- What makes Reasoning Models Different? Follow the Reasoning Leader for Efficient Decoding
2025/06/08 by Ming Li, Zhengyuan Yang, Li, Ming +11 · 5 citations
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Constraint Satisfaction and Optimization
- Approximate Recovery in Changepoint Problems, from ℓ2 Estimation Error Rates
2016/06/21 by Kevin Lin, James Sharpnack, Lin, Kevin +5 · 2 citations
Mathematics · Economics, Econometrics and Finance · #Statistical Methods and Inference #Advanced Causal Inference Techniques #Health Systems, Economic Evaluations, Quality of Life