Chai, Joyce
- Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Pass
2025/01/23 by Jianing Yang, Alexander F. Sax, Yang, Jianing +17 · 2 voices · 134 citations
Medicine · #Medical Imaging Techniques and Applications #cs.AI #cs.CV #cs.GR #cs.RO
- Experience Grounds Language
2020/04/21 by Bisk, Yonatan, Holtzman, Ari, Thomason, Jesse +9 · 14 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agent
2023/09/21 by Jianing Yang, Xuweiyi Chen, Yang, Jianing +11 · 22 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO)
- Inversion-Free Image Editing with Natural Language
2023/12/07 by Sihan Xu, Yidong Huang, Xu, Sihan +7 · 20 citations
Computer Science · Medicine · Physics and Astronomy · #Generative Adversarial Networks and Image Synthesis #Advanced Neuroimaging Techniques and Applications #Model Reduction and Neural Networks
- Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Models
2024/07/09 by Yue Zhang, Ziqiao Ma, Zhang, Yue +15 · 25 citations
Social Sciences · #Religious Tourism and Spaces #Geographic Information Systems Studies
- GROUNDHOG: Grounding Large Language Models to Holistic Segmentation
2024/02/26 by Yichi Zhang, Zhang, Yichi, Ziqiao Ma +9 · 18 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Position: Towards Bidirectional Human-AI Alignment
2024/06/13 by Hua Shen, Tiffany Knearem, Shen, Hua +45 · 2 voices · 15 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #cs.AI #cs.CL #cs.HC
- Multi-Object Hallucination in Vision-Language Models
2024/07/08 by Xuweiyi Chen, Chen, Xuweiyi, Ziqiao Ma +13 · 18 citations
Biochemistry, Genetics and Molecular Biology · Medicine · Psychology · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Epilepsy research and treatment #FOS: Computer and information sciences #Pharmacological Receptor Mechanisms and Effects #Psychedelics and Drug Studies
- Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguities
2024/10/22 by Zheyuan Zhang, Fengyuan Hu, Zhang, Zheyuan +11 · 20 citations
Psychology · #Categorization, perception, and language #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- RACER: Rich Language-Guided Failure Recovery Policies for Imitation Learning
2024/09/23 by Yinpei Dai, Jayjun Lee, Dai, Yinpei +5 · 15 citations
Computer Science · Medicine · #Anomaly Detection Techniques and Applications #COVID-19 diagnosis using AI #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Robotics (cs.RO)
- 3D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination
2024/06/07 by Jianing Yang, Xuweiyi Chen, Yang, Jianing +11 · 10 citations
Medicine · Engineering · #Medical Imaging Techniques and Applications #Advanced X-ray and CT Imaging #Advanced Surface Polishing Techniques
- Grounding Visual Illusions in Language: Do Vision-Language Models Perceive Illusions Like Humans?
2023/10/31 by Yichi Zhang, Jiayi Pan, Zhang, Yichi +7 · 8 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generation
2025/03/18 by Yu, Shoubin, Liu, Difan, Ma, Ziqiao +5 · 15 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- CycleNet: Rethinking Cycle Consistency in Text-Guided Diffusion for Image Manipulation
2023/10/19 by Xu, Sihan, Ma, Ziqiao, Huang, Yidong +2 · 7 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- DANLI: Deliberative Agent for Following Natural Language Instructions
2022/10/22 by Yichi Zhang, Zhang, Yichi, Jianing Yang +15 · 4 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Think, Act, and Ask: Open-World Interactive Personalized Robot Navigation
2023/10/12 by Dai, Yinpei, Peng, Run, Li, Sikai +1 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Robotics (cs.RO)
- Can Foundation Models Watch, Talk and Guide You Step by Step to Make a Cake?
2023/11/01 by Yuwei Bao, Keunwoo Peter Yu, Bao, Yuwei +15 · 4 citations
Computer Science · Psychology · #Intelligent Tutoring Systems and Adaptive Learning #Multimodal Machine Learning Applications #Human-Automation Interaction and Safety
- DOROTHIE: Spoken Dialogue for Handling Unexpected Situations in Interactive Autonomous Driving Agents
2022/10/22 by Ziqiao Ma, Ben VanDerPloeg, Ma, Ziqiao +12 · 3 citations
Computer Science · #Speech and dialogue systems #Topic Modeling #Multimodal Machine Learning Applications
- Bridging Language and Action: A Survey of Language-Conditioned Robot Manipulation
2023/12/17 by Xiangtong Yao, Hongkuan Zhou, Yao, Xiangtong +18 · 4 citations
Computer Science · #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robotics (cs.RO) #Topic Modeling
- In-Context Analogical Reasoning with Pre-Trained Language Models
2023/05/28 by Xiaoyang Hu, Shane Storks, Hu, Xiaoyang +5 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Training Turn-by-Turn Verifiers for Dialogue Tutoring Agents: The Curious Case of LLMs as Your Coding Tutors
2025/02/18 by Jian Wang, Yinpei Dai, Wang, Jian +9 · 7 citations
Computer Science · #Speech and dialogue systems #Text Readability and Simplification #Natural Language Processing Techniques
- DriVLMe: Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experiences
2024/06/05 by Huang, Yidong, Sansom, Jacob, Ma, Ziqiao +2 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- LinkGPT: Teaching Large Language Models To Predict Missing Links
2024/06/07 by He, Zhongmou, Zhu, Jing, Qian, Shengyi +2 · 4 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- BAD: BiAs Detection for Large Language Models in the context of candidate screening
2023/05/17 by Koh, Nam Ho, Plata, Joseph, Chai, Joyce · 2 citations
#Computation and Language (cs.CL) #F.2.2 #FOS: Computer and information sciences #I.2 #I.2.7
- Teaching Embodied Reinforcement Learning Agents: Informativeness and Diversity of Language Use
2024/10/31 by Jie Xi, Yinghui He, Xi, Jiajun +7 · 4 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Language and cultural evolution #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robotics (cs.RO)
- Towards A Holistic Landscape of Situated Theory of Mind in Large Language Models
2023/10/30 by Ma, Ziqiao, Sansom, Jacob, Peng, Run +1 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- GIPCOL: Graph-Injected Soft Prompting for Compositional Zero-Shot Learning
2023/11/09 by Guangyue Xu, Joyce Chai, Xu, Guangyue +3 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Babysit A Language Model From Scratch: Interactive Language Learning by Trials and Demonstrations
2024/05/22 by Ma, Ziqiao, Wang, Zekun, Chai, Joyce · 3 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties
2023/11/28 by Yu, Keunwoo Peter, Zhang, Zheyuan, Hu, Fengyuan +2 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Transparent and Coherent Procedural Mistake Detection
2024/12/16 by Shane Storks, Storks, Shane, Itamar Bar-Yossef +9 · 2 voices · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.AI #cs.CL
- Hierarchical Task Learning from Language Instructions with Unified Transformers and Self-Monitoring
2021/06/07 by Zhang, Yichi, Chai, Joyce · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- CX-ToM: Counterfactual Explanations with Theory-of-Mind for Enhancing Human Trust in Image Recognition Models
2021/09/03 by Akula, Arjun R., Wang, Keze, Liu, Changsong +5 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language Models
2023/06/14 by Ziqiao Ma, Jiayi Pan, Ma, Ziqiao +3 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- SAB3R: Semantic-Augmented Backbone in 3D Reconstruction
2025/06/02 by Xuweiyi Chen, Chen, Xuweiyi, Tian Xia +9 · 2 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Robotics and Sensor-Based Localization
- Proactive Assistant Dialogue Generation from Streaming Egocentric Videos
2025/06/06 by Yichi Zhang, Dong Xin, Zhang, Yichi +12 · 2 citations
Computer Science · Psychology · #Multimodal Machine Learning Applications #Topic Modeling #Social Robot Interaction and HRI
- Vision-Language Models Are Not Pragmatically Competent in Referring Expression Generation
2025/04/22 by Ma, Ziqiao, Ding, Jing, Zhang, Xuejun +6 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- 4D-LRM: Large Space-Time Reconstruction Model From and To Any View at Any Time
2025/06/23 by Ma, Ziqiao, Chen, Xuweiyi, Yu, Shoubin +10 · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Evaluating Long-Context Reasoning in LLM-Based WebAgents
2025/12/03 by Andy Chung, Yichi Zhang, Chung, Andy +9 · 1 citation
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Natural Language Processing Techniques