He, Tianyu
- IGOR: Image-GOal Representations are the Atomic Control Units for Foundation Models in Embodied AI
2024/10/17 by Xiaoyu Chen, Junliang Guo, Chen, Xiaoyu +14 · 1 voice · 19 citations
Computer Science · Engineering · Materials Science · Medicine · #Advanced Memory and Neural Computing #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning in Materials Science #Medical Imaging Techniques and Applications #Robotics (cs.RO) #cs.AI #cs.RO
- GAIA: Zero-shot Talking Avatar Generation
2023/11/26 by Tianyu He, Junliang Guo, He, Tianyu +23 · 1 voice · 10 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimedia (cs.MM) #cs.CV #cs.MM
- End-to-End Rate-Distortion Optimized 3D Gaussian Representation
2024/04/09 by Henan Wang, Wang, Henan, Hanxin Zhu +11 · 19 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Industrial Vision Systems and Defect Detection #Infrared Target Detection Methodologies #Optical measurement and interference techniques
- 3D-LLaVA: Towards Generalist 3D LMMs with Omni Superpoint Transformer
2025/01/02 by Jiajun Deng, Deng, Jiajun, Tianyu He +9 · 24 citations
Engineering · #Advanced Measurement and Metrology Techniques #Photonic and Optical Devices #Advanced Fiber Optic Sensors
- Dense Interaction Learning for Video-based Person Re-identification
2021/03/16 by Tianyu He, He, Tianyu, Xin Jin +9 · 6 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Gait Recognition and Analysis #Human Pose and Action Recognition #Video Surveillance and Tracking Methods
- Image Coding for Machines with Omnipotent Feature Learning
2022/07/05 by Feng, Ruoyu, Jin, Xin, Guo, Zongyu +6 · 7 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft
2025/04/11 by Ye Yang, Guo, Junliang, Ye, Yang +10 · 24 citations
Computer Science · Social Sciences · #Data Management and Algorithms #Geographic Information Systems Studies #Web Data Mining and Analysis
- Learning to grok: Emergence of in-context learning and skill composition in modular arithmetic tasks
2024/06/04 by Tianyu He, Darshil Doshi, He, Tianyu +5 · 10 citations
Mathematics · #Cognitive and developmental aspects of mathematical skills #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Computer and information sciences #FOS: Physical sciences #High Energy Physics - Theory (hep-th) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Models
2023/10/18 by Dingyao Yu, Kaitao Song, Yu, Dingyao +13 · 8 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Speech Recognition and Synthesis #Topic Modeling #electronic engineering #information engineering
- Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularization
2021/03/29 by Xin Jin, Jin, Xin, Tianyu He +17 · 5 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Gait Recognition and Analysis #Human Pose and Action Recognition #Video Surveillance and Tracking Methods
- GaussianSR: 3D Gaussian Super-Resolution with 2D Diffusion Priors
2024/06/14 by Xiqian Yu, Yu, Xiqian, Hanxin Zhu +5 · 8 citations
Biochemistry, Genetics and Molecular Biology · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing Techniques and Applications #Photoacoustic and Ultrasonic Imaging #Spectroscopy Techniques in Biomedical and Chemical Research
- To grok or not to grok: Disentangling generalization and memorization on corrupted algorithmic datasets
2023/10/19 by Darshil Doshi, Doshi, Darshil, Aritra Das +5 · 6 citations
Computer Science · #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification
- HiFace: High-Fidelity 3D Face Reconstruction by Learning Static and Dynamic Details
2023/03/20 by Zenghao Chai, Chai, Zenghao, Tianke Zhang +17 · 4 citations
Computer Science · Engineering · #Face recognition and analysis #Generative Adversarial Networks and Image Synthesis #3D Shape Modeling and Analysis
- EMoG: Synthesizing Emotive Co-speech 3D Gesture with Diffusion Model
2023/06/20 by Yin, Lianying, Wang, Yijun, He, Tianyu +5 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?
2024/03/10 by Hanxin Zhu, Tianyu He, Zhu, Hanxin +7 · 5 citations
Computer Science · Engineering · #Advanced Vision and Imaging #CCD and CMOS Imaging Sensors #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing Techniques and Applications
- UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editing
2024/02/20 by Bai, Jianhong, He, Tianyu, Wang, Yuchi +4 · 5 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- VidTok: A Versatile and Open-Source Video Tokenizer
2024/12/17 by A-Ling Tang, Tang, Anni, Tianyu He +7 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Video Analysis and Summarization #Video Coding and Compression Technologies
- Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos
2023/11/03 by Kalra, Dayal Singh, He, Tianyu, Barkeshli, Maissam · 4 citations
#Chaotic Dynamics (nlin.CD) #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling
2025/07/10 by H. Wu, Wu, Haoyu, D.-S. Wu +11 · 14 citations
Engineering · Computer Science · #3D Shape Modeling and Analysis #Advanced Vision and Imaging #Human Pose and Action Recognition
- InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation
2024/05/24 by Yuchi Wang, Junliang Guo, Wang, Yuchi +13 · 5 citations
Engineering · Psychology · #Human Motion and Animation #Educational Games and Gamification #Social Robot Interaction and HRI
- Grokking Modular Polynomials
2024/06/05 by Darshil Doshi, Tianyu He, Doshi, Darshil +5 · 4 citations
Mathematics · #Mathematics and Applications
- AR4D: Autoregressive 4D Generation from Monocular Videos
2025/01/03 by Hanxin Zhu, Tianyu He, Zhu, Hanxin +9 · 7 citations
Computer Science · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image and Video Stabilization
- Playing with Transformer at 30+ FPS via Next-Frame Diffusion
2025/06/02 by Cheng, Xinle, He, Tianyu, Xu, Jiayi +3 · 9 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Breathing Life into Faces: Speech-driven 3D Facial Animation with Natural Head Pose and Detailed Shape
2023/10/31 by Zhao, Wei, Wang, Yijun, He, Tianyu +3 · 2 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- A Generic Review of Integrating Artificial Intelligence in Cognitive Behavioral Therapy
2024/07/28 by Meng Jiang, Qing Zhao, Jiang, Meng +15 · 2 citations
Psychology · #Artificial Intelligence (cs.AI) #Digital Mental Health Interventions #FOS: Computer and information sciences #Mental Health Research Topics
- Enhance Images as You Like with Unpaired Learning
2021/10/04 by Sun, Xiaopeng, Li, Muxingzi, He, Tianyu +1 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #electronic engineering #information engineering
- Video In-context Learning: Autoregressive Transformers are Zero-Shot Video Imitators
2024/07/10 by Wentao Zhang, Junliang Guo, Zhang, Wentao +9 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition
- VidTwin: Video VAE with Decoupled Structure and Dynamics
2024/12/23 by Wang, Yuchi, Guo, Junliang, Xie, Xinyi +3 · 2 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Diffusion Models in 3D Vision: A Survey
2024/10/07 by Zhen Wang, Dongyuan Li, Wang, Zhen +5 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Medical Image Segmentation Techniques
- Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft
2025/10/03 by Huang, Junchao, Xiang-Ping Hu, Hu, Xinting +9 · 7 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Human Motion and Animation
- Towards a Psychological Generalist AI: A Survey of Current Applications of Large Language Models and Future Prospects
2023/12/01 by Tianyu He, Guanghui Fu, He, Tianyu +19 · 1 citation
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Digital Mental Health Interventions #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mental Health via Writing #Topic Modeling
- HiTVideo: Hierarchical Tokenizers for Enhancing Text-to-Video Generation with Autoregressive Large Language Models
2025/03/14 by Ziqin Zhou, Zhou, Ziqin, Yifan Yang +17 · 3 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Human Motion and Animation #Multimodal Machine Learning Applications
- CMC: Few-shot Novel View Synthesis via Cross-view Multiplane Consistency
2024/02/26 by Hanxin Zhu, Tianyu He, Zhu, Hanxin +3 · 1 citation
Computer Science · #Advanced Vision and Imaging #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Video Coding and Compression Technologies
- Make Your Actor Talk: Generalizable and High-Fidelity Lip Sync with Motion and Appearance Disentanglement
2024/06/12 by Runyi Yu, Tianyu He, Yu, Runyi +14 · 1 citation
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face recognition and analysis
- Language Graph Distillation for Low-Resource Machine Translation
2019/08/17 by Tianyu He, He, Tianyu, Jiale Chen +5 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
- Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications
2021/11/23 by Doshi, Darshil, He, Tianyu, Gromov, Andrey · 1 citation
#Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Computer and information sciences #FOS: Physical sciences #High Energy Physics - Theory (hep-th) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Sonic4D: Spatial Audio Generation for Immersive 4D Scene Exploration
2025/06/18 by Xie, Siyi, Chen, Xinyi, Zhu, Hanxin +3 · 2 citations
Computer Science · Neuroscience · #Music Technology and Sound Studies #Hearing Loss and Rehabilitation #Generative Adversarial Networks and Image Synthesis