Zhu, Wanrong
- LayoutGPT: Compositional Visual Planning and Generation with Large Language Models
2023/05/24 by Feng, Weixi, Zhu, Wanrong, Fu, Tsu-jui +6 · 53 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models
2023/08/02 by Anas Awadalla, Irena Gao, Awadalla, Anas +29 · 49 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context Learning
2023/01/27 by Xinyi Wang, Wang, Xinyi, Wanrong Zhu +4 · 26 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Text
2023/04/14 by Wanrong Zhu, Jack Hessel, Zhu, Wanrong +17 · 18 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigation
2023/11/13 by An Yan, Yan, An, Zhengyuan Yang +21 · 18 citations
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Social Robot Interaction and HRI
- VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street View
2023/07/12 by Schumann, Raphael, Zhu, Wanrong, Feng, Weixi +3 · 13 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- VisIT-Bench: A Benchmark for Vision-Language Instruction Following Inspired by Real-World Use
2023/08/12 by Yonatan Bitton, Hritik Bansal, Bitton, Yonatan +14 · 11 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Text Readability and Simplification
- MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos
2024/06/12 by Xuehai He, He, Xuehai, Weixi Feng +25 · 9 citations
Computer Science · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Video Surveillance and Tracking Methods
- List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
2024/04/25 by Yan An, Zhengyuan Yang, Yan, An +19 · 7 citations
Arts and Humanities · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Lexicography and Language Studies #Natural Language Processing Techniques #Semantic Web and Ontologies
- MMSci: A Dataset for Graduate-Level Multi-Discipline Multimodal Scientific Understanding
2024/07/06 by Zekun Li, Xianjun Yang, Li, Zekun +25 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Topic Modeling
- Online Covariance Matrix Estimation in Stochastic Gradient Descent
2020/02/10 by Wanrong Zhu, Xi Chen, Zhu, Wanrong +3 · 2 citations
Computer Science · Mathematics · #Stochastic Gradient Optimization Techniques #Markov Chains and Monte Carlo Methods #Privacy-Preserving Technologies in Data
- Multimodal Procedural Planning via Dual Text-Image Prompting
2023/05/02 by Lu, Yujie, Lu, Pan, Chen, Zhiyu +3 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Towards Visual Text Grounding of Multimodal Large Language Model
2025/04/07 by Li, Ming, Zhang, Ruiyi, Chen, Jian +7 · 9 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation
2020/07/01 by Zhu, Wanrong, Wang, Xin Eric, Fu, Tsu-Jui +5 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- End-to-end Dense Video Captioning as Sequence Generation
2022/04/18 by Wanrong Zhu, Zhu, Wanrong, Bo Pang +7 · 2 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Analysis and Summarization
- Neuro-Symbolic Procedural Planning with Commonsense Prompting
2022/06/06 by Yujie Lu, Weixi Feng, Lu, Yujie +11 · 2 citations
Computer Science · #AI-based Problem Solving and Planning #Topic Modeling #Natural Language Processing Techniques
- Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models
2024/04/23 by Wanrong Zhu, Jennifer Healey, Zhu, Wanrong +7 · 2 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Digital Rights Management and Security #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Multimedia Communication and Technology
- Conformal prediction after data-dependent model selection
2024/08/13 by Liang, Ruiting, Zhu, Wanrong, Barber, Rina Foygel · 2 citations
#FOS: Computer and information sciences #Methodology (stat.ME)
- Imagination-Augmented Natural Language Understanding
2022/04/18 by Lu, Yujie, Zhu, Wanrong, Wang, Xin Eric +2 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- High Confidence Level Inference is Almost Free using Parallel Stochastic Optimization
2024/01/17 by Zhu, Wanrong, Lou, Zhipeng, Wei, Ziyang +1 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Approximate co-sufficient sampling with regularization
2023/09/14 by Zhu, Wanrong, Barber, Rina Foygel · 1 citation
#FOS: Computer and information sciences #Methodology (stat.ME)