Jianfeng Wang
- The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)
2023/09/29 by Zhengyuan Yang, Linjie Li, Yang, Zhengyuan +11 · 11 voices · 83 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- GIT: A Generative Image-to-text Transformer for Vision and Language
2022/05/27 by Jianfeng Wang, Zhengyuan Yang, Wang, Jianfeng +15 · 2 voices · 56 citations
Computer Science · #Handwritten Text Recognition Techniques #Multimodal Machine Learning Applications #Natural Language Processing Techniques #cs.CV
- Satellite-to-ground quantum key distribution
2017/07/03 by Sheng‐Kai Liao, Sheng-Kai Liao, Wen-Qi Cai +46 · 2 voices · 29 citations
Computer Science · Physics and Astronomy · #Quantum Computing Algorithms and Architecture #Quantum Information and Cryptography #Quantum Mechanics and Applications #physics.optics #physics.space-ph #quant-ph
- Segment Everything Everywhere All at Once
2023/04/13 by Xueyan Zou, Zou, Xueyan, Jianwei Yang +15 · 1 voice · 88 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling #cs.CV
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities
2023/08/04 by Weihao Yu, Zhengyuan Yang, Yu, Weihao +13 · 212 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
2023/06/26 by Fuxiao Liu, Liu, Fuxiao, Kevin Lin +9 · 82 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computational Engineering #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Finance #Multimedia (cs.MM) #Multimodal Machine Learning Applications #and Science (cs.CE)
- MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action
2023/03/20 by Zhengyuan Yang, Linjie Li, Yang, Zhengyuan +16 · 68 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Florence: A New Foundation Model for Computer Vision
2021/11/22 by Lu Yuan, Yuan, Lu, Dongdong Chen +43 · 53 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- GenXD: Generating Any 3D and 4D Scenes
2024/11/04 by Yuyang Zhao, Chung-Ching Lin, Zhao, Yuyang +15 · 1 voice · 18 citations
Earth and Planetary Sciences · Engineering · #3D Modeling in Geospatial Applications #3D Surveying and Cultural Heritage #cs.AI #cs.CV
- Generalized Decoding for Pixel, Image, and Language
2022/12/21 by Xueyan Zou, Zi-Yi Dou, Zou, Xueyan +25 · 42 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- ReCo: Region-Controlled Text-to-Image Generation
2022/11/23 by Zhengyuan Yang, Yang, Zhengyuan, Jianfeng Wang +19 · 29 citations
Computer Science · #Multimodal Machine Learning Applications #Image Retrieval and Classification Techniques #Generative Adversarial Networks and Image Synthesis
- End-to-End Semi-Supervised Object Detection with Soft Teacher
2021/06/16 by Mengde Xu, Zheng Zhang, Xu, Mengde +13 · 20 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation
2023/03/22 by Shengming Yin, Yin, Shengming, Chenfei Wu +28 · 24 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Video Analysis and Summarization #Video Coding and Compression Technologies
- An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
2021/09/10 by Zhengyuan Yang, Yang, Zhengyuan, Zhe Gan +11 · 17 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Scaling Up Vision-Language Pre-training for Image Captioning
2021/11/24 by Xiaowei Hu, Hu, Xiaowei, Zhe Gan +11 · 14 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigation
2023/11/13 by An Yan, Zhengyuan Yang, Yan, An +21 · 18 citations
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Social Robot Interaction and HRI
- OpenAI GPT-5 System Card
2025/12/19 by Aaditya Singh, Adam Fry, Adam Perelman +483 · 2 voices · 37 citations
#cs.CL #cs.AI
- An Empirical Study of Training End-to-End Vision-and-Language Transformers
2021/11/03 by Zi-Yi Dou, Yichong Xu, Dou, Zi-Yi +21 · 12 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- Segment and Caption Anything
2023/12/01 by Xiaoke Huang, Huang, Xiaoke, Jianfeng Wang +13 · 1 voice · 5 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #cs.CV
- MM-Vet v2: A Challenging Benchmark to Evaluate Large Multimodal Models for Integrated Capabilities
2024/08/01 by Weihao Yu, Yu, Weihao, Zhengyuan Yang +17 · 17 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Speech and dialogue systems
- SEED: Self-supervised Distillation For Visual Representation
2021/01/12 by Zhiyuan Fang, Jianfeng Wang, Fang, Zhiyuan +9 · 8 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- AutoAssign: Differentiable Label Assignment for Dense Object Detection
2020/07/07 by Benjin Zhu, Jianfeng Wang, Zhu, Benjin +11 · 12 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques #Industrial Vision Systems and Defect Detection
- NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
2022/07/20 by Chenfei Wu, Jian Liang, Wu, Chenfei +15 · 8 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis
- UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
2021/11/23 by Zhengyuan Yang, Yang, Zhengyuan, Zhe Gan +12 · 7 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- GRiT: A Generative Region-to-text Transformer for Object Understanding
2022/12/01 by Jialian Wu, Jianfeng Wang, Wu, Jialian +11 · 8 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillation
2024/06/11 by Yuanhao Zhai, Zhai, Yuanhao, Kevin Lin +15 · 11 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image and Video Quality Assessment
- MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning
2023/11/29 by Chaoyi Zhang, Zhang, Chaoyi, Kevin Lin +13 · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Music and Audio Processing #Natural Language Processing Techniques #Video Analysis and Summarization
- MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos
2024/06/12 by Xuehai He, He, Xuehai, Weixi Feng +25 · 10 citations
Computer Science · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Video Surveillance and Tracking Methods
- Face Attention Network: An Effective Face Detector for the Occluded Faces
2017/11/20 by Jianfeng Wang, Wang, Jianfeng, Ye Yuan +3 · 7 citations
Computer Science · #Biometric Identification and Security #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face recognition and analysis #Video Surveillance and Tracking Methods
- TAP: Text-Aware Pre-training for Text-VQA and Text-Caption
2020/12/08 by Zhengyuan Yang, Yijuan Lu, Yang, Zhengyuan +15 · 5 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
2024/04/25 by Yan An, Yan, An, Zhengyuan Yang +19 · 9 citations
Arts and Humanities · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Lexicography and Language Studies #Natural Language Processing Techniques #Semantic Web and Ontologies
- Micromorphology characterization and reconstruction of sand particles using micro X-ray tomography and spherical harmonics
2014/11/21 by Bo Zhou, Jianfeng Wang, Budi Zhao · 10 citations
Engineering · Environmental Science · #Soil and Unsaturated Flow #Geotechnical Engineering and Soil Mechanics #Landslides and related hazards
- Optimized Cartesian K-Means
2014/05/16 by Jianfeng Wang, Wang, Jianfeng, Jingdong Wang +9 · 3 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Remote-Sensing Image Classification #Robotics and Sensor-Based Localization
- SlowFast-VGen: Slow-Fast Learning for Action-Driven Long Video Generation
2024/10/30 by Yining Hong, Hong, Yining, Baiyu Liu +21 · 8 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Cell Image Analysis Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Robotics (cs.RO)
- Idea2Img: Iterative Self-Refinement with GPT-4V(ision) for Automatic Image Design and Generation
2023/10/12 by Zhengyuan Yang, Yang, Zhengyuan, Jianfeng Wang +11 · 5 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- RSG: A Simple but Effective Module for Learning Imbalanced Datasets
2021/06/18 by Jianfeng Wang, Wang, Jianfeng, Thomas Lukasiewicz +7 · 3 citations
Computer Science · #Anomaly Detection Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Imbalanced Data Classification Techniques
- EditRoom: LLM-parameterized Graph Diffusion for Composable 3D Room Layout Editing
2024/10/03 by Zheng, Kaizhi, Xiaotong Chen, Xuehai He +16 · 7 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Artificial Intelligence (cs.AI) #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graph Theory and Algorithms #Graphics (cs.GR) #Human-Computer Interaction (cs.HC)
- PacBio full‐length cDNA sequencing integrated with RNA‐seq reads drastically improves the discovery of splicing transcripts in rice
2018/10/06 by Guoqiang Zhang, Min Sun, Jianfeng Wang +12 · 2 citations
Biochemistry, Genetics and Molecular Biology · #RNA Research and Splicing #RNA modifications and cancer #RNA and protein synthesis mechanisms
- Open problems in the spectral theory of signed graphs
2019/07/09 by Francesco Belardo, Belardo, Francesco, Sebastian M. Cioabă +5 · 2 citations
Computer Science · Mathematics · #05C22 #05C50 #Combinatorics (math.CO) #Discrete Mathematics (cs.DM) #FOS: Computer and information sciences #FOS: Mathematics #Graph theory and applications #Matrix Theory and Algorithms #Spectral Theory in Mathematical Physics
- MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos
2023/06/07 by Jielin Qiu, Jiacheng Zhu, Qiu, Jielin +21 · 3 citations
Computer Science · #Video Analysis and Summarization #Natural Language Processing Techniques #Music and Audio Processing
- DEM modelling of mini-triaxial test based on one-to-one mapping of sand particles
2020/05/01 by Mengmeng Wu, Jianfeng Wang, Adrian Russell +2 · 8 citations
Engineering · #Geotechnical Engineering and Soil Mechanics #Geotechnical Engineering and Underground Structures #Granular flow and fluidized beds
- An investigation of the breakage behaviour of a pre-crushed carbonate sand under shear using X-ray micro-tomography
2021/07/24 by Zhuang Cheng, Jianfeng Wang · 2 citations
Engineering · Environmental Science · #Geotechnical Engineering and Soil Mechanics #Landslides and related hazards #Rock Mechanics and Modeling
- MiniVLM: A Smaller and Faster Vision-Language Model
2020/12/13 by Jianfeng Wang, Xiaowei Hu, Wang, Jianfeng +13 · 2 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- COSMO: COntrastive Streamlined MultimOdal Model with Interleaved Pre-Training
2024/01/01 by Alex Jinpeng Wang, Linjie Li, Wang, Alex Jinpeng +13 · 3 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Doping evolution of superconductivity, charge order and band topology in hole-doped topological kagome superconductors Cs(V1-xTix)3Sb5
2021/10/25 by Yixuan Liu, Yuan Wang, Liu, Yixuan +33 · 2 citations
Materials Science · Physics and Astronomy · #Advanced Condensed Matter Physics #Electronic and Structural Properties of Oxides #FOS: Physical sciences #Superconductivity (cond-mat.supr-con) #Topological Materials and Phenomena
- Wheat MAPK cascade mediates SGT1 nuclear entry targeted by a stripe rust effector
2025/03/10 by Weixue Shu, Tong Yan, S Jing +8 · 1 voice · 3 citations
Agricultural and Biological Sciences · Biochemistry, Genetics and Molecular Biology · #Plant Pathogens and Fungal Diseases #Plant tissue culture and regeneration #Plant-Microbe Interactions and Immunity
- A machine learning-based strategy for experimentally estimating force chains of granular materials using X-ray micro-tomography
2023/01/13 by Zhuang Cheng, Jianfeng Wang, Wei Xiong · 4 citations
Engineering · Environmental Science · #Rock Mechanics and Modeling #Landslides and related hazards #Geotechnical and Geomechanical Engineering
- Facial Motion Prior Networks for Facial Expression Recognition
2019/02/23 by Yuedong Chen, Jianfeng Wang, Chen, Yuedong +7 · 1 citation
Computer Science · Psychology · #Computer Vision and Pattern Recognition (cs.CV) #Emotion and Mood Recognition #FOS: Computer and information sciences #Face and Expression Recognition #Face recognition and analysis
- Train performance analysis using heterogeneous statistical models
2021/08/04 by Jianfeng Wang, Wang, Jianfeng, Jun Yu +1 · 1 citation
Engineering · #Railway Engineering and Dynamics #Vehicle emissions and performance #Aerodynamics and Fluid Dynamics Research
- A novel particle tracking method for granular sands based on spherical harmonic rotational invariants
2018/01/08 by B. Zhou, Bo Zhou, Jianfeng Wang +2 · 2 citations
Environmental Science · Engineering · #Landslides and related hazards #Soil and Unsaturated Flow #Rock Mechanics and Modeling
- Detection Hub: Unifying Object Detection Datasets via Query Adaptation on Language Embedding
2022/06/07 by Lingchen Meng, Xiyang Dai, Meng, Lingchen +17 · 1 citation
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Exploring Discrete Diffusion Models for Image Captioning
2022/11/21 by Zixin Zhu, Zhu, Zixin, Yixuan Wei +17 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Video Analysis and Summarization
- Learning 3D Photography Videos via Self-supervised Diffusion on Single Images
2023/02/21 by Xiaodong Wang, Chenfei Wu, Wang, Xiaodong +21 · 1 citation
Computer Science · #Advanced Image Processing Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis
- Almost 100 % electron transfer regime over Fe−Co dual-atom catalyst toward pollutants removal: Regulation of peroxymonosulfate adsorption mode
2023/08/14 by Fei Wang, Ya Gao, Huifen Fu +8 · 2 citations
Environmental Science · Energy · Engineering · #Advanced oxidation water treatment #Advanced Photocatalysis Techniques #Environmental remediation with nanomaterials
- Entity6K: A Large Open-Domain Evaluation Dataset for Real-World Entity Recognition
2024/03/19 by Jielin Qiu, Qiu, Jielin, William Han +15 · 1 citation
Computer Science · Decision Sciences · #Computer Vision and Pattern Recognition (cs.CV) #Data Quality and Management #FOS: Computer and information sciences #Topic Modeling #Web Data Mining and Analysis