Chuang Gan
- AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
2023/06/01 by Ji Lin, Lin, Ji, Jiaming Tang +18 · 1 voice · 297 citations
Computer Science · Engineering · #Topic Modeling #Ferroelectric and Negative Capacitance Devices #Speech Recognition and Synthesis
- Once-for-All: Train One Network and Specialize it for Efficient Deployment
2019/08/26 by Han Cai, Chuang Gan, Cai, Han +7 · 1 voice · 53 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #cs.CV #cs.LG #stat.ML
- Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision
2023/05/04 by Zhiqing Sun, Yikang Shen, Sun, Zhiqing +13 · 2 voices · 19 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.CY #cs.LG
- QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
2024/05/07 by Yujun Lin, Haotian Tang, Lin, Yujun +12 · 1 voice · 43 citations
Computer Science · Engineering · #Wireless Power Transfer Systems #cs.AI #cs.CL #cs.LG #cs.PF
- Aligning Large Multimodal Models with Factually Augmented RLHF
2023/09/25 by Zhiqing Sun, Sun, Zhiqing, Sheng Shen +21 · 104 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Text Readability and Simplification #Topic Modeling
- TSM: Temporal Shift Module for Efficient Video Understanding
2018/11/20 by Ji Lin, Chuang Gan, Lin, Ji +3 · 50 citations
Computer Science · #Human Pose and Action Recognition #Video Surveillance and Tracking Methods #Advanced Neural Network Applications
- 3D-LLM: Injecting the 3D World into Large Language Models
2023/07/24 by Yining Hong, Haoyu Zhen, Hong, Yining +11 · 1 voice · 69 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO) #cs.AI #cs.CL #cs.CV #cs.LG #cs.RO
- CLEVRER: CoLlision Events for Video REpresentation and Reasoning
2019/10/03 by Kexin Yi, Chuang Gan, Yi, Kexin +11 · 50 citations
Computer Science · #Multimodal Machine Learning Applications #Explainable Artificial Intelligence (XAI) #Human Pose and Action Recognition
- ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planning
2023/09/28 by Qiao Gu, Gu, Qiao, Alihusein Kuwajerwala +29 · 73 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Constraint Satisfaction and Optimization #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Robotics (cs.RO)
- 3D-VLA: A 3D Vision-Language-Action Generative World Model
2024/03/14 by Haoyu Zhen, Xiaowen Qiu, Zhen, Haoyu +13 · 76 citations
Engineering · Earth and Planetary Sciences · #Robotics and Automated Systems #3D Surveying and Cultural Heritage #Spatial Cognition and Navigation
- The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision
2019/04/26 by Jiayuan Mao, Chuang Gan, Mao, Jiayuan +7 · 32 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens
2025/06/20 by Zeyuan Yang, Xueyang Yu, Yang, Zeyuan +7 · 2 voices · 28 citations
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Language, Metaphor, and Cognition #Multimodal Machine Learning Applications
- Building Cooperative Embodied Agents Modularly with Large Language Models
2023/07/05 by Hongxin Zhang, Zhang, Hongxin, Weihua Du +13 · 33 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Robotics (cs.RO) #Topic Modeling
- RoboDreamer: Learning Compositional World Models for Robot Imagination
2024/04/18 by Siyuan Zhou, Zhou, Siyuan, Yilun Du +9 · 38 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Robotic Path Planning Algorithms #Robotics (cs.RO) #Robotics and Automated Systems
- Planning with Large Language Models for Code Generation
2023/03/09 by Shun Zhang, Zhenfang Chen, Zhang, Shun +9 · 25 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Programming Languages (cs.PL) #Software Engineering Research #Software Testing and Debugging Techniques
- The Sound of Pixels
2018/04/09 by Hang Zhao, Zhao, Hang, Chuang Gan +9 · 15 citations
Computer Science · Engineering · #Acoustic Wave Phenomena Research #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation
2020/07/09 by Chuang Gan, Gan, Chuang, J. Schwartz +44 · 20 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Graphics (cs.GR) #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robotics (cs.RO)
- STAR: A Benchmark for Situated Reasoning in Real-World Videos
2024/05/15 by Bo Wu, Shoubin Yu, Wu, Bo +7 · 31 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Analysis and Summarization
- PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identification
2023/03/09 by Xuan Li, Li, Xuan, Yi-Ling Qiao +11 · 20 citations
Computer Science · Physics and Astronomy · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Human Pose and Action Recognition #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Robotics (cs.RO)
- Dense Regression Network for Video Grounding
2020/04/07 by Runhao Zeng, Zeng, Runhao, Haoming Xu +9 · 15 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Learning Neural Acoustic Fields
2022/04/04 by Andrew Luo, Yilun Du, Luo, Andrew +9 · 15 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Music and Audio Processing #Animal Vocal Communication and Behavior #Music Technology and Sound Studies
- Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidance
2023/12/17 by Phuc D. A. Nguyen, Nguyen, Phuc D. A., Tuan Ngo +11 · 21 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery
2024/05/16 by Pingchuan Ma, Tsun-Hsuan Wang, Ma, Pingchuan +13 · 21 citations
Decision Sciences · #Scientific Computing and Data Management
- VQS: Linking Segmentations to Questions and Answers for Supervised Attention in VQA and Question-Focused Semantic Segmentation
2017/08/15 by Chuang Gan, Gan, Chuang, Yandong Li +7 · 10 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- The Sound of Motions
2019/04/11 by Hang Zhao, Zhao, Hang, Chuang Gan +5 · 8 citations
Computer Science · #Music Technology and Sound Studies
- Look, Listen, and Act: Towards Audio-Visual Embodied Navigation
2019/12/25 by Chuang Gan, Gan, Chuang, Yiwei Zhang +7 · 8 citations
Neuroscience · Computer Science · #Tactile and Sensory Interactions #Music and Audio Processing #Advanced Image and Video Retrieval Techniques
- DELTA: Dense Efficient Long-range 3D Tracking for any video
2024/10/31 by Tuan Ngo, Ngo, Tuan Duc, Peiye Zhuang +11 · 19 citations
Computer Science · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Enhancement Techniques #Video Surveillance and Tracking Methods
- Towards Understanding Camera Motions in Any Video
2025/04/21 by Zhiqiu Lin, Lin, Zhiqiu, Siyuan Cen +27 · 1 voice · 21 citations
Computer Science · #Advanced Vision and Imaging
- Learning Neural Constitutive Laws From Motion Observations for Generalizable PDE Dynamics
2023/04/27 by Pingchuan Ma, Peter Yichen Chen, Ma, Pingchuan +11 · 10 citations
Physics and Astronomy · Engineering · Computer Science · #Model Reduction and Neural Networks #Robot Manipulation and Learning #Human Pose and Action Recognition
- Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Properties
2023/06/27 by Hsiao-Yu Fish Tung, Mingyu Ding, Tung, Hsiao-Yu +15 · 10 citations
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Data Visualization and Analytics #FOS: Computer and information sciences #Graphics (cs.GR) #Human Pose and Action Recognition #Robotics (cs.RO)
- 3D Concept Learning and Reasoning from Multi-View Images
2023/03/20 by Yining Hong, Hong, Yining, Chunru Lin +9 · 9 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
2024/03/14 by Zhiqing Sun, Sun, Zhiqing, Longhui Yu +11 · 12 citations
Computer Science · #Image Retrieval and Classification Techniques
- Physically Compatible 3D Object Modeling from a Single Image
2024/05/30 by Minghao Guo, Bohan Wang, Guo, Minghao +15 · 11 citations
Computer Science · Earth and Planetary Sciences · #3D Surveying and Cultural Heritage #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing and 3D Reconstruction
- Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling
2025/02/04 by Xiaowen Qiu, Qiu, Xiaowen, Jincheng Yang +12 · 16 citations
Computer Science · Earth and Planetary Sciences · #3D Surveying and Cultural Heritage #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing and 3D Reconstruction #Natural Language Processing Techniques #Robotics (cs.RO)
- TesserAct: Learning 4D Embodied World Models
2025/04/29 by Haoyu Zhen, Zhen, Haoyu, Qiao Sun +11 · 23 citations
Computer Science · Psychology · #Generative Adversarial Networks and Image Synthesis #Social Robot Interaction and HRI #Multimodal Machine Learning Applications
- See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning
2023/01/12 by Zhenfang Chen, Qinhong Zhou, Chen, Zhenfang +9 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Defensive Quantization: When Efficiency Meets Robustness
2019/04/17 by Ji Lin, Chuang Gan, Lin, Ji +3 · 5 citations
Computer Science · Physics and Astronomy · #Adversarial Robustness in Machine Learning #Radiation Detection and Scintillator Technologies #Advanced Neural Network Applications
- LSceneLLM: Enhancing Large 3D Scene Understanding Using Adaptive Visual Preferences
2024/12/02 by Hongyan Zhi, Zhi, Hongyan, Peihao Chen +15 · 14 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Vision and Imaging #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Visual Concept-Metaconcept Learning
2020/02/04 by Chi Han, Han, Chi, Jiayuan Mao +7 · 5 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning in Bioinformatics #Multimodal Machine Learning Applications
- Retrospectives on the Embodied AI Workshop
2022/10/13 by Matt Deitke, Deitke, Matt, Dhruv Batra +74 · 6 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World
2024/01/16 by Yining Hong, Zishuo Zheng, Hong, Yining +9 · 8 citations
Computer Science · Psychology · #Multimodal Machine Learning Applications #Language, Metaphor, and Cognition
- Graph Convolutional Module for Temporal Action Localization in Videos
2021/12/01 by Runhao Zeng, Wenbing Huang, Zeng, Runhao +11 · 5 citations
Computer Science · #Anomaly Detection Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Tools
2022/03/31 by Xingyu Lin, Zhiao Huang, Lin, Xingyu +9 · 5 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Machine Learning (cs.LG) #Robot Manipulation and Learning #Robotics (cs.RO)
- Music Gesture for Visual Sound Separation
2020/04/20 by Chuang Gan, Deng Huang, Gan, Chuang +7 · 4 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Learning Vision-and-Language Navigation from YouTube Videos
2023/07/22 by Kunyang Lin, Lin, Kunyang, Peihao Chen +9 · 6 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Human Pose and Action Recognition
- Adaptive Online Replanning with Diffusion Models
2023/10/14 by Siyuan Zhou, Zhou, Siyuan, Yilun Du +13 · 6 citations
Computer Science · #Artificial Intelligence in Games #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Robotic Path Planning Algorithms #Robotics (cs.RO)
- Physics-Driven Diffusion Models for Impact Sound Synthesis from Videos
2023/03/29 by Kun Su, Kaizhi Qian, Su, Kun +7 · 5 citations
Computer Science · #Music and Audio Processing #Music Technology and Sound Studies #Generative Adversarial Networks and Image Synthesis
- HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments
2024/01/23 by Qinhong Zhou, Sunli Chen, Zhou, Qinhong +15 · 6 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Disaster Management and Resilience #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physics
2023/03/27 by Sizhe Li, Zhiao Huang, Li, Sizhe +11 · 5 citations
Computer Science · Engineering · Psychology · #Action Observation and Synchronization #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Robot Manipulation and Learning #Robotics (cs.RO)
- RISP: Rendering-Invariant State Predictor with Differentiable Simulation and Rendering for Cross-Domain Parameter Estimation
2022/05/11 by Pingchuan Ma, Tao Du, Ma, Pingchuan +7 · 4 citations
Computer Science · Medicine · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Human Pose and Action Recognition #Machine Learning (cs.LG) #Robotics (cs.RO) #Stroke Rehabilitation and Recovery
- Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Search
2025/02/04 by Maohao Shen, Guangtao Zeng, Shen, Maohao +17 · 12 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Software Engineering Research
- Recurrent Topic-Transition GAN for Visual Paragraph Generation
2017/03/21 by Xiaodan Liang, Zhiting Hu, Liang, Xiaodan +7 · 5 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Gait Recognition in the Wild with Multi-hop Temporal Switch
2022/09/01 by Jinkai Zheng, Zheng, Jinkai, Xinchen Liu +13 · 4 citations
Engineering · Medicine · Computer Science · #Gait Recognition and Analysis #Diabetic Foot Ulcer Assessment and Management #Human Pose and Action Recognition
- SOK-Bench: A Situated Video Reasoning Benchmark with Aligned Open-World Knowledge
2024/05/15 by Andong Wang, Wang, Andong, Bo Wu +13 · 6 citations
Computer Science · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Explainable Artificial Intelligence (XAI)
- Found a Reason for me? Weakly-supervised Grounded Visual Question\n Answering using Capsules
2021/05/11 by Aisha Urooj Khan, Khan, Aisha Urooj, Hilde Kuehne +9 · 3 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- ConMe: Rethinking Evaluation of Compositional Reasoning for Modern VLMs
2024/06/12 by Irene Huang, Wei Lin, Huang, Irene +24 · 7 citations
Engineering · Computer Science · #Elevator Systems and Control #Software System Performance and Reliability #Advanced Software Engineering Methodologies
- GENOME: GenerativE Neuro-symbOlic visual reasoning by growing and reusing ModulEs
2023/11/08 by Zhenfang Chen, Rui Sun, Chen, Zhenfang +7 · 4 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Masked Motion Encoding for Self-Supervised Video Representation Learning
2022/10/12 by Xinyu Sun, Peihao Chen, Sun, Xinyu +10 · 3 citations
Computer Science · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Human Pose and Action Recognition
- Learning Physical Dynamics with Subequivariant Graph Neural Networks
2022/10/13 by Jiaqi Han, Wenbing Huang, Han, Jiaqi +9 · 3 citations
Computer Science · #Computational Physics and Python Applications #Time Series Analysis and Forecasting #Topic Modeling
- MindJourney: Test-Time Scaling with World Models for Spatial Reasoning
2025/07/16 by Jiageng Liu, Yang, Yuncong, Liu, Jiageng +11 · 11 citations
Computer Science · #Constraint Satisfaction and Optimization #Semantic Web and Ontologies #Data Management and Algorithms
- Weakly Supervised Dense Event Captioning in Videos
2018/12/10 by Xuguang Duan, Duan, Xuguang, Wenbing Huang +9 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Analysis and Summarization
- ModuleFormer: Modularity Emerges from Mixture-of-Experts
2023/06/07 by Yikang Shen, Zheyu Zhang, Shen, Yikang +9 · 3 citations
Computer Science · Medicine · #Topic Modeling #Domain Adaptation and Few-Shot Learning #COVID-19 diagnosis using AI
- Foley Music: Learning to Generate Music from Videos
2020/07/21 by Chuang Gan, Gan, Chuang, Deng Huang +7 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Human Pose and Action Recognition #Machine Learning (cs.LG) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- Location-aware Graph Convolutional Networks for Video Question Answering
2020/08/07 by Deng Huang, Peihao Chen, Huang, Deng +9 · 2 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Learning 3D Persistent Embodied World Models
2025/05/05 by Siyuan Zhou, Yilun Du, Zhou, Siyuan +11 · 9 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robotics (cs.RO)
- End-to-End Learning of Motion Representation for Video Understanding
2018/04/02 by Lijie Fan, Wenbing Huang, Fan, Lijie +9 · 2 citations
Computer Science · Medicine · #Human Pose and Action Recognition #Anomaly Detection Techniques and Applications #Diabetic Foot Ulcer Assessment and Management
- PTR: A Benchmark for Part-based Conceptual, Relational, and Physical Reasoning
2021/12/09 by Yining Hong, Hong, Yining, Yi Li +7 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Visual Attention and Saliency Detection
- On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-Learning
2021/02/20 by Ren Wang, Kaidi Xu, Wang, Ren +11 · 2 citations
Computer Science · Medicine · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Thermal Regulation in Medicine
- Revisiting the Effectiveness of Off-the-shelf Temporal Modeling Approaches for Large-scale Video Classification
2017/08/12 by Yunlong Bian, Chuang Gan, Bian, Yunlong +17 · 3 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Learning Active Camera for Multi-Object Navigation
2022/10/14 by Peihao Chen, Chen, Peihao, Dongyu Ji +13 · 2 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robotics (cs.RO)
- Hyper-Decision Transformer for Efficient Online Policy Adaptation
2023/04/17 by Mengdi Xu, Xu, Mengdi, Yuchen Lu +9 · 2 citations
Computer Science · #Reinforcement Learning in Robotics #Adversarial Robustness in Machine Learning #Machine Learning and Data Classification
- RSPNet: Relative Speed Perception for Unsupervised Video Representation Learning
2020/10/27 by Peihao Chen, Chen, Peihao, Deng Huang +13 · 2 citations
Computer Science · #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning
- Scaling Autonomous Agents via Automatic Reward Modeling And Planning
2025/02/17 by Zhenfang Chen, Delin Chen, Chen, Zhenfang +7 · 4 citations
Computer Science · #Multi-Agent Systems and Negotiation #Logic, Reasoning, and Knowledge
- Interactive Fiction Game Playing as Multi-Paragraph Reading Comprehension with Reinforcement Learning
2020/10/05 by Xiaoxiao Guo, Guo, Xiaoxiao, Mo Yu +9 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Adversarial Option-Aware Hierarchical Imitation Learning
2021/06/10 by Mingxuan Jing, Wenbing Huang, Jing, Mingxuan +11 · 1 citation
Computer Science · Engineering · #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Adversarial Robustness in Machine Learning
- Certifiably Robust Interpretation via Renyi Differential Privacy
2021/07/04 by Ao Liu, Liu, Ao, Xiaoyu Chen +7 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Privacy-Preserving Technologies in Data #Explainable Artificial Intelligence (XAI)
- Network Augmentation for Tiny Deep Learning
2021/10/17 by Han Cai, Chuang Gan, Cai, Han +5 · 1 citation
Computer Science · Medicine · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)
- When Does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning?
2021/11/01 by Lijie Fan, Sijia Liu, Fan, Lijie +7 · 1 citation
Computer Science · Medicine · #Domain Adaptation and Few-Shot Learning #Adversarial Robustness in Machine Learning #COVID-19 diagnosis using AI
- Compositional Physical Reasoning of Objects and Events from Videos
2024/08/02 by Zhenfang Chen, Shilong Dong, Chen, Zhenfang +13 · 2 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics and Automated Systems #Semantic Web and Ontologies #Video Analysis and Summarization
- MA2QL: A Minimalist Approach to Fully Decentralized Multi-Agent Reinforcement Learning
2022/09/17 by Kefan Su, Siyuan Zhou, Su, Kefan +8 · 1 citation
Computer Science · Decision Sciences · #Distributed Control Multi-Agent Systems #FOS: Computer and information sciences #Game Theory and Applications #Machine Learning (cs.LG) #Multiagent Systems (cs.MA) #Reinforcement Learning in Robotics
- Visual Dependency Transformers: Dependency Tree Emerges from Reversed Attention
2023/04/06 by Mingyu Ding, Ding, Mingyu, Yikang Shen +13 · 1 citation
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Visual Attention and Saliency Detection
- UBSoft: A Simulation Platform for Robotic Skill Learning in Unbounded Soft Environments
2024/11/19 by Chunru Lin, Lin, Chunru, Jugang Fan +15 · 2 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Robot Manipulation and Learning #Robotics (cs.RO) #Robotics and Automated Systems
- SocialGPT: Prompting LLMs for Social Relation Reasoning via Greedy Segment Optimization
2024/10/28 by Wanhua Li, Zibin Meng, Li, Wanhua +9 · 2 citations
Computer Science · #Intelligent Tutoring Systems and Adaptive Learning #Topic Modeling #Multi-Agent Systems and Negotiation
- Generalizable Long-Horizon Manipulations with Large Language Models
2023/10/03 by Haoyu Zhou, Mingyu Ding, Zhou, Haoyu +9 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robotics (cs.RO) #Topic Modeling
- Virtual Community: An Open World for Humans, Robots, and Society
2025/08/20 by Qinhong Zhou, Zhou, Qinhong, Hongxin Zhang +32 · 4 citations
Engineering · #Robotics and Automated Systems
- RapVerse: Coherent Vocals and Whole-Body Motions Generations from Text
2024/05/30 by Jianjiu Chen, Xin Yan, Chen, Jiaben +16 · 1 citation
Computer Science · Engineering · #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Human Motion and Animation #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- TalkCuts: A Large-Scale Dataset for Multi-Shot Human Speech Video Generation
2025/10/08 by Jiaben Chen, Chen, Jiaben, Ailing Zeng +18 · 3 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications #Speech and Audio Processing
- GS-Agent: Creating 4D Physical Worlds With Generative Simulation
2026/07/23 by Hongxin Zhang, Chunru Lin, Junyan Li +3
#cs.RO #cs.AI #cs.CL #cs.CV