Fu, Jianlong
- CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
2024/11/29 by Li, Qixiu, Liang, Yaobo, Wang, Zeyu +15 · 116 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- TinyViT: Fast Pretraining Distillation for Small Vision Transformers
2022/07/21 by Kan Wu, Jinnian Zhang, Wu, Kan +11 · 38 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Visual Attention and Saliency Detection
- Learning Spatio-Temporal Transformer for Visual Tracking
2021/03/31 by Yan, Bin, Peng, Houwen, Fu, Jianlong +2 · 31 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Language
2019/12/08 by Songyang Zhang, Houwen Peng, Zhang, Songyang +5 · 28 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Information Retrieval (cs.IR) #Multimedia (cs.MM) #Multimodal Machine Learning Applications #Video Analysis and Summarization
- Expanding Language-Image Pretrained Models for General Video Recognition
2022/08/04 by Bolin Ni, Ni, Bolin, Houwen Peng +13 · 35 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Multimodal Machine Learning Applications #Cancer-related molecular mechanisms research #Domain Adaptation and Few-Shot Learning
- MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
2022/12/19 by Ludan Ruan, Yiyang Ma, Ruan, Ludan +15 · 29 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Music Technology and Sound Studies #Music and Audio Processing
- CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment
2022/09/14 by Xue, Hongwei, Yuchong Sun, Bei Liu +10 · 21 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Cancer-related molecular mechanisms research #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Learning Texture Transformer Network for Image Super-Resolution
2020/06/07 by Fuzhi Yang, Huan Yang, Yang, Fuzhi +7 · 15 citations
Computer Science · Engineering · #Advanced Image Processing Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing Techniques and Applications
- NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation
2023/03/22 by Shengming Yin, Chenfei Wu, Yin, Shengming +28 · 19 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Video Analysis and Summarization #Video Coding and Compression Technologies
- Rethinking and Improving Relative Position Encoding for Vision Transformer
2021/07/29 by Wu, Kan, Peng, Houwen, Chen, Minghao +2 · 14 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- AutoFormer: Searching Transformers for Visual Recognition
2021/07/01 by Minghao Chen, Houwen Peng, Chen, Minghao +5 · 11 citations
Computer Science · #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Learning Joint Spatial-Temporal Transformations for Video Inpainting
2020/07/20 by Zeng, Yanhong, Fu, Jianlong, Chao, Hongyang · 9 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Aggregated Contextual Transformations for High-Resolution Image Inpainting
2021/04/03 by Yanhong Zeng, Zeng, Yanhong, Jianlong Fu +5 · 9 citations
Computer Science · #AI in cancer detection #Advanced Image Processing Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis
- Zero-Reference Low-Light Enhancement via Physical Quadruple Priors
2024/03/19 by Wenjing Wang, Huan Yang, Wang, Wenjing +5 · 15 citations
Engineering · #Advanced Photonic Communication Systems #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Photonic and Optical Devices
- Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generation
2023/05/18 by Wenjing Wang, Huan Yang, Wang, Wenjing +11 · 11 citations
Computer Science · Engineering · #Generative Adversarial Networks and Image Synthesis #Human Motion and Animation #Video Analysis and Summarization
- Learning Trajectory-Aware Transformer for Video Super-Resolution
2022/04/08 by Chengxu Liu, Huan Yang, Liu, Chengxu +5 · 8 citations
Computer Science · Engineering · #Advanced Image Processing Techniques #Advanced Vision and Imaging #Image Processing Techniques and Applications
- LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search
2021/04/29 by Bin Yan, Houwen Peng, Yan, Bin +9 · 6 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Video Surveillance and Tracking Methods
- Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
2020/04/02 by Huang, Zhicheng, Zeng, Zhaoyang, Liu, Bei +2 · 5 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM)
- 4D LUT: Learnable Context-Aware 4D Lookup Table for Image Enhancement
2022/09/05 by Liu, Chengxu, Yang, Huan, Fu, Jianlong +1 · 6 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #electronic engineering #information engineering
- MiniViT: Compressing Vision Transformers with Weight Multiplexing
2022/04/14 by Jinnian Zhang, Houwen Peng, Zhang, Jinnian +11 · 5 citations
Engineering · Computer Science · #CCD and CMOS Imaging Sensors #Visual Attention and Saliency Detection #Advanced Neural Network Applications
- MovieFactory: Automatic Movie Creation from Text using Large Generative Models for Language and Images
2023/06/12 by Zhu, Junchen, Yang, Huan, He, Huiguo +6 · 6 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Multi-Scale 2D Temporal Adjacent Networks for Moment Localization with Natural Language
2020/12/04 by Zhang, Songyang, Peng, Houwen, Fu, Jianlong +2 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Unified Multi-Modal Latent Diffusion for Joint Subject and Text Conditional Image Generation
2023/03/16 by Yiyang Ma, Ma, Yiyang, Huan Yang +7 · 5 citations
Computer Science · #Multimodal Machine Learning Applications #Generative Adversarial Networks and Image Synthesis #Domain Adaptation and Few-Shot Learning
- Learning Deep Bilinear Transformation for Fine-grained Image Representation
2019/11/09 by Heliang Zheng, Zheng, Heliang, Jianlong Fu +5 · 3 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Medical Imaging and Analysis #Domain Adaptation and Few-Shot Learning
- 360-Indoor: Towards Learning Real-World Objects in 360° Indoor Equirectangular Images
2019/10/03 by Chou, Shih-Han, Sun, Cheng, Chang, Wen-Yen +3 · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
2021/04/07 by Zhicheng Huang, Huang, Zhicheng, Zhaoyang Zeng +9 · 3 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Domain-Aware Universal Style Transfer
2021/08/10 by Hong, Kibeom, Jeon, Seogkyu, Yang, Huan +2 · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #electronic engineering #information engineering
- Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning
2022/10/12 by Yuchong Sun, Sun, Yuchong, Xue, Hongwei +8 · 3 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Cancer-related molecular mechanisms research #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Learning Pyramid-Context Encoder Network for High-Quality Image\n Inpainting
2019/04/16 by Yanhong Zeng, Zeng, Yanhong, Fu Jianlong +5 · 2 citations
Computer Science · #Advanced Image Processing Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis
- WSOD2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection
2019/09/11 by Zhaoyang Zeng, Zeng, Zhaoyang, Bei Liu +7 · 2 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
- Transferring Foundation Models for Generalizable Robotic Manipulation
2023/06/09 by Jiange Yang, Wenhui Tan, Yang, Jiange +13 · 3 citations
Engineering · #Robot Manipulation and Learning #Robotic Mechanisms and Dynamics #Innovations in Concrete and Construction Materials
- Spatiotemporal Predictive Pre-training for Robotic Motor Control
2024/03/08 by Yang, Jiange, Liu, Bei, Fu, Jianlong +3 · 4 citations
#FOS: Computer and information sciences #Robotics (cs.RO)
- Probing Inter-modality: Visual Parsing with Self-Attention for Vision-Language Pre-training
2021/06/25 by Hongwei Xue, Yupan Huang, Xue, Hongwei +11 · 2 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Searching the Search Space of Vision Transformer
2021/11/29 by Chen, Minghao, Wu, Kan, Ni, Bolin +5 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- PromptFix: You Prompt and We Fix the Photo
2024/05/27 by Yongsheng Yu, Ziyun Zeng, Yu, Yongsheng +7 · 4 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications
- Learn to Scale: Generating Multipolar Normalized Density Maps for Crowd Counting
2019/07/29 by Chenfeng Xu, Kai Qiu, Xu, Chenfeng +9 · 3 citations
Computer Science · Social Sciences · #Video Surveillance and Tracking Methods #Anomaly Detection Techniques and Applications #Human Mobility and Location-Based Analysis
- ViCo: Engaging Video Comment Generation with Human Preference Rewards
2023/08/22 by Sun, Yuchong, Liu, Bei, Chen, Xu +2 · 2 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Image Inspired Poetry Generation in XiaoIce
2018/08/09 by Wen‐Feng Cheng, Chao-Chung Wu, Cheng, Wen-Feng +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications #Video Analysis and Summarization
- Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions
2018/01/27 by Li, Qing, Fu, Jianlong, Yu, Dongfei +2 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-grained Image Recognition
2019/03/14 by Heliang Zheng, Zheng, Heliang, Jianlong Fu +5 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
- Cyclic Differentiable Architecture Search
2020/06/18 by Yu, Hongyuan, Peng, Houwen, Huang, Yan +4 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- One-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space Shrinking
2021/04/01 by Chen, Minghao, Peng, Houwen, Fu, Jianlong +1 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- AlphaBlock: Embodied Finetuning for Vision-Language Reasoning in Robot Manipulation
2023/05/30 by Jin, Chuhao, Tan, Wenhui, Yang, Jiange +4 · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Robotics (cs.RO)
- Learning Spatiotemporal Frequency-Transformer for Compressed Video Super-Resolution
2022/08/05 by Zhongwei Qiu, Qiu, Zhongwei, Huan Yang +5 · 1 citation
Computer Science · Engineering · #Advanced Image Processing Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing Techniques and Applications #Image and Signal Denoising Methods
- Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-Resolution
2023/05/24 by Ma, Yiyang, Yang, Huan, Yang, Wenhan +2 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #electronic engineering #information engineering
- SINC: Self-Supervised In-Context Learning for Vision-Language Tasks
2023/07/15 by Yi-Syuan Chen, Chen, Yi-Syuan, Yun-Zhu Song +9 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Learning Profitable NFT Image Diffusions via Multiple Visual-Policy Guided Reinforcement Learning
2023/06/20 by Huiguo He, He, Huiguo, Tianfu Wang +13 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Image Retrieval and Classification Techniques
- Show, Adapt and Tell: Adversarial Training of Cross-domain Image Captioner
2017/05/02 by Tseng-Hung Chen, Yuan-Hong Liao, Chen, Tseng-Hung +9 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications