vix.ing · top · new · best · stats · spec

Ma, Xiaojian

  1. An Embodied Generalist Agent in 3D World
    2023/11/18 by Jiangyong Huang, Silong Yong, Huang, Jiangyong +17 · 70 citations
    Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Domain Adaptation and Few-Shot Learning
  2. SQA3D: Situated Question Answering in 3D Scenes
    2022/10/14 by Xiaojian Ma, Ma, Xiaojian, Silong Yong +11 · 45 citations
    Computer Science · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Natural Language Processing Techniques
  3. UltraEdit: Instruction-based Fine-Grained Image Editing at Scale
    2024/07/07 by Zhao, Haozhe, Ma, Xiaojian, Chen, Liang +7 · 70 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  4. VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding
    2024/03/18 by Yue Fan, Fan, Yue, Xiaojian Ma +11 · 58 citations
    Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
  5. Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents
    2023/02/03 by Zihao Wang, Shaofei Cai, Wang, Zihao +8 · 42 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  6. 3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment
    2023/08/08 by Ziyu Zhu, Zhu, Ziyu, Xiaojian Ma +9 · 39 citations
    Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
  7. JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models
    2023/11/10 by Zihao Wang, Shaofei Cai, Wang, Zihao +21 · 26 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  8. MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning
    2023/09/14 by Haozhe Zhao, Zefan Cai, Zhao, Haozhe +17 · 19 citations
    Computer Science · Social Sciences · #Speech and dialogue systems #Geographic Information Systems Studies
  9. Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splatting
    2024/03/22 by Jun Guo, Guo, Jun, Xiaojian Ma +7 · 16 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Video Analysis and Summarization #Image Retrieval and Classification Techniques
  10. RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation
    2024/03/08 by Zihao Wang, Wang, Zihao, Anji Liu +9 · 15 citations
    Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Context-Aware Activity Recognition Systems #Emotion and Mood Recognition #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning
  11. Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage
    2024/12/20 by Gao, Zhi, Zhang, Bofei, Li, Pengxiang +7 · 21 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  12. Imitation Learning from Observations by Minimizing Inverse Dynamics Disagreement
    2019/10/10 by Yang, Chao, Ma, Xiaojian, Huang, Wenbing +4 · 6 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Robotics (cs.RO)
  13. CLOVA: A Closed-Loop Visual Assistant with Tool Usage and Update
    2023/12/18 by Zhi Gao, Yuntao Du, Gao, Zhi +11 · 12 citations
    Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Online Learning and Analytics #Semantic Web and Ontologies
  14. Unifying 3D Vision-Language Understanding via Promptable Queries
    2024/05/19 by Ziyu Zhu, Zhu, Ziyu, Zhuofan Zhang +15 · 13 citations
    Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Constraint Satisfaction and Optimization
  15. Multi-modal Situated Reasoning in 3D Scenes
    2024/09/04 by Xiongkun Linghu, Jiangyong Huang, Linghu, Xiongkun +9 · 14 citations
    Computer Science · #Constraint Satisfaction and Optimization #Multimodal Machine Learning Applications #Semantic Web and Ontologies
  16. Vision-based Teleoperation of Shadow Dexterous Hand using End-to-End Deep Neural Network
    2018/09/17 by Li, Shuang, Ma, Xiaojian, Liang, Hongzhuo +5 · 4 citations
    #FOS: Computer and information sciences #Robotics (cs.RO)
  17. MindAgent: Emergent Gaming Interaction
    2023/09/18 by Gong, Ran, Huang, Qiuyuan, Ma, Xiaojian +8 · 7 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Multiagent Systems (cs.MA)
  18. Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions
    2022/05/27 by Jiang, Huaizu, Ma, Xiaojian, Nie, Weili +4 · 5 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  19. Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigation
    2025/07/05 by Zhu, Ziyu, Wang, Xilin, Li, Yixuan +9 · 19 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  20. Bongard-OpenWorld: Few-Shot Reasoning for Free-form Visual Concepts in the Real World
    2023/10/16 by Wu, Rujie, Ma, Xiaojian, Zhang, Zhenliang +4 · 5 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  21. A Mobile Robot Hand-Arm Teleoperation System by Vision and IMU
    2020/03/11 by Li, Shuang, Jiang, Jiaxi, Ruppel, Philipp +5 · 3 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Robotics (cs.RO)
  22. TongUI: Internet-Scale Trajectories from Multimodal Web Tutorials for Generalized GUI Agents
    2025/04/17 by Bofei Zhang, Zhang, Bofei, Gao Zhi +16 · 13 citations
    Computer Science · #AI in Service Interactions #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems
  23. OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents
    2024/06/27 by Wang, Zihao, Cai, Shaofei, Mu, Zhancun +7 · 6 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  24. Reinforcement Learning from Imperfect Demonstrations under Soft Expert Guidance
    2019/11/16 by Mingxuan Jing, Xiaojian Ma, Jing, Mingxuan +11 · 2 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics #Robotics (cs.RO)
  25. GROOT: Learning to Follow Instructions by Watching Gameplay Videos
    2023/10/12 by Shaofei Cai, Bowei Zhang, Cai, Shaofei +9 · 4 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Games #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics
  26. Embodied VideoAgent: Persistent Memory from Egocentric Videos and Embodied Sensors Enables Dynamic Scene Understanding
    2024/12/31 by Yue Fan, Fan, Yue, Xiaojian Ma +11 · 5 citations
    Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Reinforcement Learning in Robotics
  27. FlowDreamer: A RGB-D World Model with Flow-based Motion Representations for Robot Manipulation
    2025/05/15 by Jun Guo, Xiaojian Ma, Guo, Jun +9 · 5 citations
    Engineering · #3D Shape Modeling and Analysis #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Robotics (cs.RO)
  28. JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse
    2025/03/20 by Muyao Li, Li, Muyao, Zihao Wang +7 · 7 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hand Gesture Recognition Systems #Multimodal Machine Learning Applications #Robotics and Automated Systems
  29. ROCKET-1: Mastering Open-World Interaction with Visual-Temporal Context Prompting
    2024/10/23 by Shaofei Cai, Zihao Wang, Cai, Shaofei +10 · 5 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Data Visualization and Analytics #FOS: Computer and information sciences
  30. Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction
    2023/01/21 by Shaofei Cai, Cai, Shaofei, Zihao Wang +7 · 2 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
  31. Adversarial Option-Aware Hierarchical Imitation Learning
    2021/06/10 by Mingxuan Jing, Jing, Mingxuan, Wenbing Huang +11 · 1 citation
    Computer Science · Engineering · #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Adversarial Robustness in Machine Learning
  32. Task-oriented Sequential Grounding and Navigation in 3D Scenes
    2024/08/07 by Zhang, Zhuofan, Zhu, Ziyu, Li, Junhao +8 · 2 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  33. Iterative Tool Usage Exploration for Multimodal Agents via Step-wise Preference Tuning
    2025/04/30 by Pengxiang Li, Zhi Gao, Li, Pengxiang +18 · 6 citations
    Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Semantic Web and Ontologies #Speech and dialogue systems
  34. Latent Diffusion Energy-Based Model for Interpretable Text Modeling
    2022/06/13 by Peiyu Yu, Yu, Peiyu, Sirui Xie +15 · 1 citation
    Computer Science · Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
  35. Learning Energy-Based Prior Model with Diffusion-Amortized MCMC
    2023/10/05 by Peiyu Yu, Yu, Peiyu, Yaxuan Zhu +11 · 1 citation
    Computer Science · #Generative Adversarial Networks and Image Synthesis #Machine Learning in Healthcare
  36. LongViTU: Instruction Tuning for Long-Form Video Understanding
    2025/01/09 by Rujie Wu, Wu, Rujie, Xiaojian Ma +13 · 2 citations
    Computer Science · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Video Analysis and Summarization
  37. Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation
    2022/11/28 by Jiangyong Huang, Huang, Jiangyong, William Yicheng Zhu +11 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Visual Attention and Saliency Detection
  38. LEO-VL: Efficient Scene Representation for Scalable 3D Vision-Language Learning
    2025/06/11 by Huang, Jiangyong, Ma, Xiaojian, Linghu, Xiongkun +8 · 2 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  39. "Noisier" Noise Contrastive Eestimation is (Almost) Maximum Likelihood
    2024/05/27 by Peiyu Yu, Yu, Peiyu, Dinghuai Zhang +21 · 1 citation
    Computer Science · #Applications (stat.AP) #Artificial Intelligence (cs.AI) #Artificial Intelligence in Games #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Topic Modeling
  40. GROOT-2: Weakly Supervised Multi-Modal Instruction Following Agents
    2024/12/07 by Cai, Shaofei, Zhang, Bowei, Wang, Zihao +4 · 1 citation
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)