Read My Mind: A Multi-Modal Dataset for Human Belief Prediction

2023/03/07 by Jiafei Duan, Duan, Jiafei, Samson S. Yu +7
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC)

paper · pdf · doi:10.48550/arxiv.2304.14501

openalex publication_date 2023/03/07 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Understanding human intentions is key to enabling effective and efficient human-robot interaction (HRI) in collaborative settings. To enable developments and evaluation of the ability of artificial intelligence (AI) systems to infer human beliefs, we introduce a large-scale multi-modal video dataset for intent prediction based on object-context relations.

Related

• BOSS: A Benchmark for Human Belief Prediction in Object-context Scenarios
• Bayesian Intention for Enhanced Human Robot Collaboration
• Data Efficient Human Intention Prediction: Leveraging Neural Network Verification and Expert Guidance
• MINT-RVAE: Multi-Cues Intention Prediction of Human-Robot Interaction using Human Pose and Emotion Information from RGB-only Camera Data
• Explicit Modelling of Theory of Mind for Belief Prediction in Nonverbal Social Interactions