Huang, Siyuan
- Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning
2021/05/10 by Pan Lu, Lu, Pan, Ran Gong +11 · 103 citations
Computer Science · #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- An Embodied Generalist Agent in 3D World
2023/11/18 by Jiangyong Huang, Silong Yong, Huang, Jiangyong +17 · 93 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Domain Adaptation and Few-Shot Learning
- SQA3D: Situated Question Answering in 3D Scenes
2022/10/14 by Xiaojian Ma, Silong Yong, Ma, Xiaojian +11 · 66 citations
Computer Science · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Natural Language Processing Techniques
- 3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment
2023/08/08 by Ziyu Zhu, Zhu, Ziyu, Xiaojian Ma +9 · 60 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Neural-Symbolic Recursive Machine for Systematic Generalization
2022/10/04 by Qing Li, Li, Qing, Yixin Zhu +11 · 1 voice · 3 citations
Computer Science · #Topic Modeling #Neural Networks and Applications #Natural Language Processing Techniques
- Diffusion-based Generation, Optimization, and Planning in 3D Scenes
2023/01/15 by Siyuan Huang, Huang, Siyuan, Zan Wang +13 · 44 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Human Pose and Action Recognition
- HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes
2022/10/18 by Wang, Zan, Chen, Yixin, Liu, Tengyu +3 · 38 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devices
2024/06/12 by Lu, Quanfeng, Shao, Wenqi, Liu, Zitao +7 · 51 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models
2023/06/15 by Peng Xu, Wenqi Shao, Xu, Peng +17 · 35 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Parts
2022/11/10 by Haoran Geng, Helin Xu, Geng, Haoran +11 · 29 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Robot Manipulation and Learning
- SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding
2024/01/17 by Baoxiong Jia, Jia, Baoxiong, Yixin Chen +13 · 41 citations
Computer Science · Earth and Planetary Sciences · #3D Surveying and Cultural Heritage #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO)
- SPHINX: The Joint Mixing of Weights, Tasks, and Visual Embeddings for Multi-modal Large Language Models
2023/11/13 by Ziyi Lin, Chris Liu, Lin, Ziyi +29 · 33 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- EgoTaskQA: Understanding Human Tasks in Egocentric Videos
2022/10/08 by Baoxiong Jia, Jia, Baoxiong, Ting Lei +5 · 24 citations
Computer Science · #Multimodal Machine Learning Applications #Explainable Artificial Intelligence (XAI) #Human Pose and Action Recognition
- Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skill
2023/09/19 by Wenzhe Cai, Siyuan Huang, Cai, Wenzhe +11 · 30 citations
Computer Science · Engineering · #Multimodal Machine Learning Applications #Robotic Path Planning Algorithms #Robotics and Sensor-Based Localization
- Spatio-temporal Self-Supervised Representation Learning for 3D Point Clouds
2021/09/01 by Siyuan Huang, Huang, Siyuan, Yichen Xie +5 · 19 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Robotics and Sensor-Based Localization
- Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
2024/03/29 by Weifeng Lin, Lin, Weifeng, Xinyu Wei +15 · 33 citations
Social Sciences · #Computer Vision and Pattern Recognition (cs.CV) #Digital Accessibility for Disabilities #FOS: Computer and information sciences
- Scaling Up Dynamic Human-Scene Interaction Modeling
2024/03/13 by Nan Jiang, Zhiyuan Zhang, Jiang, Nan +15 · 31 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Human Pose and Action Recognition
- PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI
2024/04/15 by Yandan Yang, Yang, Yandan, Baoxiong Jia +5 · 31 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Human Motion and Animation #Human Pose and Action Recognition #Machine Learning (cs.LG) #Robotics (cs.RO)
- Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
2024/02/22 by Xudong Lü, Qi Liu, Lu, Xudong +13 · 28 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Recommender Systems and Techniques #Speech and dialogue systems
- Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
2023/05/18 by Siyuan Huang, Zhengkai Jiang, Huang, Siyuan +9 · 21 citations
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents
2024/07/03 by Yuxiang Chai, Chai, Yuxiang, Siyuan Huang +13 · 29 citations
Computer Science · #Artificial Intelligence (cs.AI) #Context-Aware Activity Recognition Systems #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Mobile Agent-Based Network Management #Multimedia (cs.MM) #Web Data Mining and Analysis
- Multi-modal Sensor Fusion for Auto Driving Perception: A Survey
2022/02/06 by Huang, Keli, Shi, Botian, Li, Xiang +3 · 15 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #I.2.10
- GenDexGrasp: Generalizable Dexterous Grasping
2022/10/03 by Puhao Li, Tengyu Liu, Li, Puhao +11 · 15 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hand Gesture Recognition Systems #Human Pose and Action Recognition #Robot Manipulation and Learning #Robotics (cs.RO)
- Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance
2024/03/26 by Zan Wang, Yixin Chen, Wang, Zan +17 · 24 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners
2023/03/03 by Renrui Zhang, Zhang, Renrui, Xiangfei Hu +13 · 16 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- Full-Body Articulated Human-Object Interaction
2022/12/20 by Nan Jiang, Jiang, Nan, Tengyu Liu +14 · 14 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hand Gesture Recognition Systems #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes
2023/04/09 by Ran Gong, Gong, Ran, Jiangyong Huang +20 · 16 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Robotics (cs.RO) #Topic Modeling
- LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities
2020/07/31 by Jia, Baoxiong, Chen, Yixin, Huang, Siyuan +2 · 9 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Adversarial Texture for Fooling Person Detectors in the Physical World
2022/03/07 by Zhanhao Hu, Siyuan Huang, Hu, Zhanhao +9 · 11 citations
Computer Science · #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #Digital Media Forensic Detection #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis
- Unifying 3D Vision-Language Understanding via Promptable Queries
2024/05/19 by Ziyu Zhu, Zhu, Ziyu, Zhuofan Zhang +15 · 19 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Constraint Satisfaction and Optimization
- ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splatting
2025/02/26 by Yu Liu, Liu, Yu, Baoxiong Jia +9 · 30 citations
Computer Science · Earth and Planetary Sciences · Engineering · #Image Processing and 3D Reconstruction #3D Surveying and Cultural Heritage #Robotics and Sensor-Based Localization
- Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V
2024/04/16 by Peiyuan Zhi, Zhi, Peiyuan, Zhiyuan Zhang +14 · 16 citations
Computer Science · #AI in Service Interactions #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Robotics (cs.RO) #Speech and dialogue systems
- Multi-modal Situated Reasoning in 3D Scenes
2024/09/04 by Xiongkun Linghu, Linghu, Xiongkun, Jiangyong Huang +9 · 20 citations
Computer Science · #Constraint Satisfaction and Optimization #Multimodal Machine Learning Applications #Semantic Web and Ontologies
- EnerVerse: Envisioning Embodied Future Space for Robotics Manipulation
2025/01/03 by Siyuan Huang, Liliang Chen, Huang, Siyuan +17 · 22 citations
Engineering · Social Sciences · #Architecture and Computational Design #Computer Vision and Pattern Recognition (cs.CV) #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO) #Robotics and Automated Systems
- SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models
2024/02/08 by Renrui Zhang, Liu, Dongyang, Zhang, Renrui +34 · 12 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture
2023/11/01 by Yixin Chen, Chen, Yixin, Junfeng Ni +9 · 11 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Advanced Vision and Imaging #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learning
2025/03/27 by Kailin Li, Puhao Li, Li, Kailin +7 · 26 citations
Engineering · Psychology · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Robot Manipulation and Learning #Robotics (cs.RO) #Social Robot Interaction and HRI
- RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learning
2025/04/26 by Geng, Haoran, Wang, Feishi, Wei, Songlin +34 · 32 citations
#FOS: Computer and information sciences #Robotics (cs.RO)
- Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image
2018/08/07 by Huang, Siyuan, Qi, Siyuan, Zhu, Yixin +3 · 5 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decoding
2025/03/03 by Yiming Wang, Wang, Yiming, Pei Zhang +11 · 25 citations
Computer Science · #Network Packet Processing and Optimization #Speech Recognition and Synthesis
- PartAfford: Part-level Affordance Discovery from 3D Objects
2022/02/28 by Xu, Chao, Chen, Yixin, Wang, He +3 · 6 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Autonomous Character-Scene Interaction Synthesis from Text Instruction
2024/10/04 by Nan Jiang, Zimo He, Jiang, Nan +11 · 14 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Human Motion and Animation #Natural Language Processing Techniques
- PhyRecon: Physically Plausible Neural Scene Reconstruction
2024/04/25 by Junfeng Ni, Yixin Chen, Ni, Junfeng +16 · 11 citations
Biochemistry, Genetics and Molecular Biology · #Cell Image Analysis Techniques
- Improving Object-centric Learning with Query Optimization
2022/10/17 by Jia, Baoxiong, Liu, Yu, Huang, Siyuan · 6 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- YouRefIt: Embodied Reference Understanding with Language and Gesture
2021/09/08 by Yixin Chen, Qing Li, Chen, Yixin +13 · 5 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Speech and dialogue systems
- CLONE: Closed-Loop Whole-Body Humanoid Teleoperation for Long-Horizon Tasks
2025/06/10 by Li, Yixuan, Lin, Yutang, Cui, Jieming +4 · 27 citations
#FOS: Computer and information sciences #Robotics (cs.RO)
- Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense
2019/09/04 by Yixin Chen, Siyuan Huang, Chen, Yixin +8 · 6 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Surveillance and Tracking Methods
- PhysPart: Physically Plausible Part Completion for Interactable Objects
2024/08/25 by Rundong Luo, Luo, Rundong, Haoran Geng +13 · 11 citations
Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Modular Robots and Swarm Intelligence #Robotics (cs.RO)
- Mirror-Consistency: Harnessing Inconsistency in Majority Voting
2024/10/07 by Siyuan Huang, Huang, Siyuan, Zhiyuan Ma +9 · 10 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Electoral Systems and Political Participation #FOS: Computer and information sciences
- Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning
2019/09/04 by Lifeng Fan, Wenguan Wang, Fan, Lifeng +7 · 4 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Gaze Tracking and Assistive Technology #Multimodal Machine Learning Applications #Visual Attention and Saliency Detection
- ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Models
2024/03/17 by Siyuan Huang, Iaroslav Ponomarenko, Huang, Siyuan +13 · 8 citations
Computer Science · #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robotics (cs.RO) #Topic Modeling
- Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulation
2025/08/07 by Liao, Yue, Zhou, Pengfei, Huang, Siyuan +11 · 23 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
- 3D Vision and Language Pretraining with Large-Scale Synthetic Data
2024/07/08 by Dejie Yang, Xu Zhu, Yang, Dejie +9 · 11 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Robotics and Automated Systems
- ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Models
2025/06/19 by Li, Puhao, Wu, Yingying, Xi, Ziheng +8 · 21 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigation
2025/07/05 by Zhu, Ziyu, Wang, Xilin, Li, Yixuan +9 · 19 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Human-centric Indoor Scene Synthesis Using Stochastic Grammar
2018/08/25 by Siyuan Qi, Yixin Zhu, Qi, Siyuan +7 · 3 citations
Computer Science · Environmental Science · #Advanced Vision and Imaging #Video Surveillance and Tracking Methods #Remote Sensing and LiDAR Applications
- A3: Android Agent Arena for Mobile GUI Agents
2025/01/02 by Chai, Yuxiang, Li, Hanhao, Zhang, Jiayu +6 · 11 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructions
2024/09/23 by Weifeng Lin, Xinyu Wei, Lin, Weifeng +18 · 7 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Pretraining Language Models to Ponder in Continuous Space
2025/05/27 by Zeng, Boyi, Song, Shixiang, Huang, Siyuan +6 · 14 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agents
2024/03/19 by Jieming Cui, Cui, Jieming, Tengyu Liu +9 · 6 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Robotics (cs.RO) #Text Readability and Simplification
- Ag2Manip: Learning Novel Manipulation Skills with Agent-Agnostic Visual and Action Representations
2024/04/26 by Puhao Li, Li, Puhao, Tengyu Liu +15 · 7 citations
Computer Science · #Multi-Agent Systems and Negotiation
- Decompositional Neural Scene Reconstruction with Generative Diffusion Prior
2025/03/19 by Ni, Junfeng, Liu, Yu, Lu, Ruijie +4 · 12 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- EnerVerse-AC: Envisioning Embodied Environments with Action Condition
2025/05/14 by Yuxin Jiang, Jiang, Yuxin, Shengcong Chen +17 · 13 citations
Neuroscience · Computer Science · #Embodied and Extended Cognition #Data Visualization and Analytics
- Cooperative Holistic Scene Understanding: Unifying 3D Object, Layout, and Camera Pose Estimation
2018/10/31 by Huang, Siyuan, Qi, Siyuan, Xiao, Yinxue +3 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- F-HOI: Toward Fine-grained Semantic-Aligned 3D Human-Object Interactions
2024/07/17 by Yang, Jie, Niu, Xuesong, Jiang, Nan +2 · 5 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Unveiling the Mist over 3D Vision-Language Understanding: Object-centric Evaluation with Chain-of-Analysis
2025/03/28 by Jiangyong Huang, Huang, Jiangyong, Baoxiong Jia +13 · 10 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Domain Adaptation and Few-Shot Learning
- Effective Tuning Strategies for Generalist Robot Manipulation Policies
2024/10/02 by Wenbo Zhang, Zhang, Wenbo, Yang Li +13 · 6 citations
Engineering · Computer Science · #Robot Manipulation and Learning #Robotic Mechanisms and Dynamics #Evolutionary Algorithms and Applications
- MetaScenes: Towards Automated Replica Creation for Real-world 3D Scans
2025/05/05 by Huangyue Yu, Yu, Huangyue, Baoxiong Jia +21 · 11 citations
Engineering · #Additive Manufacturing and 3D Printing Technologies #Manufacturing Process and Optimization #Modular Robots and Swarm Intelligence
- TinyLVLM-eHub: Towards Comprehensive and Efficient Evaluation for Large Vision-Language Models
2023/08/07 by Shao, Wenqi, Lei, Meng, Hu, Yutao +8 · 3 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- A3VLM: Actionable Articulation-Aware Vision Language Model
2024/06/11 by Siyuan Huang, Haonan Chang, Huang, Siyuan +13 · 4 citations
Computer Science · #FOS: Computer and information sciences #Hand Gesture Recognition Systems #Multimodal Machine Learning Applications #Robotics (cs.RO) #Speech and dialogue systems
- Infrared Invisible Clothing:Hiding from Infrared Detectors at Multiple Angles in Real World
2022/05/12 by Zhu, Xiaopei, Hu, Zhanhao, Huang, Siyuan +2 · 2 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Cluster-wise Graph Transformer with Dual-granularity Kernelized Attention
2024/10/09 by Siyuan Huang, Huang, Siyuan, Yunchong Song +5 · 4 citations
Computer Science · Social Sciences · #Advanced Computing and Algorithms #Advanced Graph Neural Networks #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG)
- StyleLoco: Generative Adversarial Distillation for Natural Humanoid Robot Locomotion
2025/03/19 by Ma, Le, Meng, Ziyu, Liu, Tengyu +4 · 8 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Robotics (cs.RO)
- Task-oriented Sequential Grounding and Navigation in 3D Scenes
2024/08/07 by Zhang, Zhuofan, Zhu, Ziyu, Li, Junhao +8 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models
2025/05/14 by Yue Hu, Siyuan Huang, Yue, Hu +11 · 7 citations
Computer Science · #Multimodal Machine Learning Applications #Generative Adversarial Networks and Image Synthesis #Face recognition and analysis
- Dynamic Motion Blending for Versatile Motion Editing
2025/03/26 by Jiang, Nan, Li, Hongjie, Yuan, Ziye +5 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- DreamArt: Generating Interactable Articulated Objects from a Single Image
2025/07/08 by Lu, Ruijie, Liu, Yu, Tang, Jiaxiang +6 · 10 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM
2023/08/25 by Zhao, Zhiyuan, Ouyang, Linke, Wang, Bin +5 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Predicting Human Activities Using Stochastic Grammar
2017/08/02 by Qi, Siyuan, Huang, Siyuan, Wei, Ping +1 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- RoboCerebra: A Large-scale Benchmark for Long-horizon Robotic Manipulation Evaluation
2025/06/07 by Songhao Han, Han, Songhao, Qiu, Boxiang +10 · 7 citations
Computer Science · Engineering · Psychology · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Robot Manipulation and Learning #Robotics (cs.RO) #Social Robot Interaction and HRI
- Nonlinear Local Metric Learning for Person Re-identification
2015/11/16 by Siyuan Huang, Jiwen Lu, Huang, Siyuan +5 · 2 citations
Computer Science · Engineering · #Video Surveillance and Tracking Methods #Gait Recognition and Analysis #Human Pose and Action Recognition
- A Competence-aware Curriculum for Visual Concepts Learning via Question Answering
2020/07/03 by Qing Li, Siyuan Huang, Li, Qing +5 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning
2020/06/11 by Li, Qing, Huang, Siyuan, Hong, Yining +3 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- InteractAnything: Zero-shot Human Object Interaction Synthesis via LLM Feedback and Object Affordance Parsing
2025/05/30 by Jinlu Zhang, Zhang, Jinlu, Yixin Chen +9 · 5 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Natural Language Processing Techniques #Topic Modeling
- UniAff: A Unified Representation of Affordances for Tool Usage and Articulation with Vision-Language Models
2024/09/30 by Qiaojun Yu, Yu, Qiaojun, Siyuan Huang +21 · 3 citations
Computer Science · #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robotics (cs.RO) #Semantic Web and Ontologies
- VLGrammar: Grounded Grammar Induction of Vision and Language
2021/03/24 by Hong, Yining, Li, Qing, Zhu, Song-Chun +1 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Masked Point-Entity Contrast for Open-Vocabulary 3D Scene Understanding
2025/04/28 by Yan Wang, Wang, Yan, Baoxiong Jia +5 · 5 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Robotics and Sensor-Based Localization
- GWM: Towards Scalable Gaussian World Models for Robotic Manipulation
2025/08/25 by Lu, Guanxing, Jia, Baoxiong, Li, Puhao +4 · 6 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- CrayonRobo: Object-Centric Prompt-Driven Vision-Language-Action Model for Robotic Manipulation
2025/05/04 by Xiaoqi Li, Lingyun Xu, Li, Xiaoqi +19 · 4 citations
Engineering · #FOS: Computer and information sciences #Robot Manipulation and Learning #Robotics (cs.RO) #Robotics and Automated Systems
- Adversarial Data Collection: Human-Collaborative Perturbations for Efficient and Robust Robotic Imitation Learning
2025/03/14 by Siyuan Huang, Huang, Siyuan, Liao, Yue +12 · 3 citations
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- VILLS -- Video-Image Learning to Learn Semantics for Person Re-Identification
2023/11/27 by Siyuan Huang, Huang, Siyuan, Prabhakar, Ram +4 · 2 citations
Computer Science · Engineering · #Video Surveillance and Tracking Methods #Face recognition and analysis #Gait Recognition and Analysis
- Taccel: Scaling Up Vision-based Tactile Robotics via High-performance GPU Simulation
2025/04/17 by Yuyang Li, Wenxin Du, Li, Yuyang +15 · 5 citations
Engineering · #Advanced Sensor and Energy Harvesting Materials #Soft Robotics and Applications #Dielectric materials and actuators
- Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation
2022/11/28 by Jiangyong Huang, William Yicheng Zhu, Huang, Jiangyong +11 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Visual Attention and Saliency Detection
- Learning a Unified Policy for Position and Force Control in Legged Loco-Manipulation
2025/05/27 by Peiyuan Zhi, Zhi, Peiyuan, Peiyang Li +7 · 3 citations
Engineering · #FOS: Computer and information sciences #Muscle activation and electromyography studies #Robot Manipulation and Learning #Robotic Locomotion and Control #Robotics (cs.RO)
- TACO: Taming Diffusion for in-the-wild Video Amodal Completion
2025/03/15 by Lu, Ruijie, Chen, Yixin, Liu, Yu +5 · 5 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Gumbel Reranking: Differentiable End-to-End Reranker Optimization
2025/02/16 by Huang, Siyuan, Ma, Zhiyuan, Du, Jintao +5 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- ProBio: A Protocol-guided Multimodal Dataset for Molecular Biology Lab
2023/11/01 by Cui, Jieming, Gong, Ziren, Jia, Baoxiong +4 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Whole-body Detection, Recognition and Identification at Altitude and Range
2023/11/09 by Huang, Siyuan, Kathirvel, Ram Prabhakar, Lau, Chun Pong +1 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- SlotLifter: Slot-guided Feature Lifting for Learning Object-centric Radiance Fields
2024/08/13 by Yu Liu, Baoxiong Jia, Liu, Yu +5 · 2 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Artificial Intelligence (cs.AI) #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing and 3D Reconstruction #Machine Learning (cs.LG) #Robotics (cs.RO)
- SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agent
2025/09/24 by Yandan Yang, Baoxiong Jia, Yang, Yandan +5 · 6 citations
Computer Science · Engineering · #Computer Graphics and Visualization Techniques #Human Motion and Animation #Image Processing and 3D Reconstruction
- MOVIS: Enhancing Multi-Object Novel View Synthesis for Indoor Scenes
2024/12/16 by Ruijie Lu, Lu, Ruijie, Yixin Chen +13 · 3 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics and Sensor-Based Localization
- Spotlight on Token Perception for Multimodal Reinforcement Learning
2025/10/10 by Huang, Siyuan, Qu, Xiaoye, Li, Yafu +4 · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- ARFlow: Human Action-Reaction Flow Matching with Physical Guidance
2025/03/21 by Jiang, Wentao, Wang, Jingya, Ji, Kaiyang +3 · 2 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting
2025/09/29 by He, Zefeng, Qu, Xiaoye, Li, Yafu +3 · 7 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Distillation-guided Representation Learning for Unconstrained Gait Recognition
2023/07/27 by Guo, Yuxiang, Huang, Siyuan, Prabhakar, Ram +3 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Advancing 3D Scene Understanding with MV-ScanQA Multi-View Reasoning Evaluation and TripAlign Pre-training Dataset
2025/08/14 by Mo, Wentao, Chen, Qingchao, Peng, Yuxin +2 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimedia (cs.MM)
- SKT: Integrating State-Aware Keypoint Trajectories with Vision-Language Models for Robotic Garment Manipulation
2024/09/26 by Li, Xin, Huang, Siyuan, Yu, Qiaojun +6 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
- LEO-VL: Efficient Scene Representation for Scalable 3D Vision-Language Learning
2025/06/11 by Huang, Jiangyong, Ma, Xiaojian, Linghu, Xiongkun +8 · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- GROVE: A Generalized Reward for Learning Open-Vocabulary Physical Skill
2025/04/05 by Jieming Cui, Cui, Jieming, Tengyu Liu +13 · 2 citations
Computer Science · Engineering · #Multimodal Machine Learning Applications #Robot Manipulation and Learning #Human Motion and Animation
- Trace3D: Consistent Segmentation Lifting via Gaussian Instance Tracing
2025/08/05 by Shen, Hongyu, Ni, Junfeng, Chen, Yixin +3 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences