Conghui He

1. InternLM2 Technical Report
   2024/03/26 by Zheng Cai, Maosong Cao, Cai, Zheng +199 · 2 voices · 57 citations
   Medicine · Computer Science · #Artificial Intelligence in Healthcare and Education #Topic Modeling #Machine Learning in Healthcare
2. MMBench: Is Your Multi-modal Model an All-around Player?
   2023/07/12 by Yuan Liu, Haodong Duan, Liu, Yuan +21 · 399 citations
   Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
3. Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling
   2024/12/06 by Zhe Chen, Weiyun Wang, Chen, Zhe +86 · 3 voices · 427 citations
   Computer Science · Decision Sciences · #Topic Modeling #Scientific Computing and Data Management #Machine Learning and Data Classification
4. ShareGPT4V: Improving Large Multi-Modal Models with Better Captions
   2023/11/21 by Lin Chen, Jisong Li, Jinsong Li +14 · 1 voice · 126 citations
   Computer Science · #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #cs.CV
5. How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites
   2024/04/25 by Zhe Chen, Weiyun Wang, Chen, Zhe +59 · 169 citations
   Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Reservoir Engineering and Simulation Methods
6. OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation
   2023/11/29 by Qidong Huang, Huang, Qidong, Xiaoyi Dong +15 · 88 citations
   Computer Science · #Advanced Graph Neural Networks #Big Data and Digital Economy #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning in Healthcare
7. PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction
   2024/10/22 by Long Xing, Qidong Huang, Xing, Long +19 · 67 citations
   Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Multimodal Machine Learning Applications
8. MinerU: An Open-Source Solution for Precise Document Content Extraction
   2024/09/27 by Bin Wang, Wang, Bin, Chao Xu +32 · 62 citations
   Computer Science · #Natural Language Processing Techniques #Web Data Mining and Analysis #Semantic Web and Ontologies
9. Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Driving
   2023/05/10 by Xiaosong Jia, Jia, Xiaosong, Penghao Wu +11 · 34 citations
   Engineering · Computer Science · #Autonomous Vehicle Technology and Safety #Advanced Neural Network Applications #Reinforcement Learning in Robotics
10. Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
    2023/11/28 by Zhiyuan Zhao, Zhao, Zhiyuan, Bin Wang +9 · 29 citations
    Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Sentiment Analysis and Opinion Mining #Topic Modeling
11. VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis
    2024/03/29 by Chao Pang, Xingxing Weng, Pang, Chao +19 · 25 citations
    Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Image Retrieval and Classification Techniques #Remote-Sensing Image Classification
12. LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training
    2024/06/24 by Tong Zhu, Zhu, Tong, Xiaoye Qu +11 · 18 citations
    Computer Science · Engineering · #Computation and Language (cs.CL) #Context-Aware Activity Recognition Systems #FOS: Computer and information sciences #Indoor and Outdoor Localization Technologies #Mobile Crowdsensing and Crowdsourcing
13. KeyVideoLLM: Towards Large-scale Video Keyframe Selection
    2024/07/03 by Hao Liang, Liang, Hao, Jiapeng Li +14 · 16 citations
    Computer Science · #Video Analysis and Summarization #Advanced Image and Video Retrieval Techniques #Web Data Mining and Analysis
14. DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception
    2024/10/16 by Zhiyuan Zhao, Hengrui Kang, Zhao, Zhiyuan +5 · 22 citations
    Computer Science · #Image Retrieval and Classification Techniques
15. Stop Looking for Important Tokens in Multimodal Language Models: Duplication Matters More
    2025/02/17 by Zichen Wen, Yifeng Gao, Wen, Zichen +13 · 29 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech and dialogue systems
16. OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?
    2025/01/09 by Yifei Li, Li, Yifei, Junbo Niu +26 · 21 citations
    Computer Science · #Video Analysis and Summarization
17. PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmark
    2022/03/21 by Li Chen, Chonghao Sima, Chen, Li +19 · 8 citations
    Computer Science · Engineering · #Advanced Neural Network Applications #Advanced Vision and Imaging #Autonomous Vehicle Technology and Safety #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
18. A Survey of Multimodal Large Language Model from A Data-centric Perspective
    2024/05/26 by Tianyi Bai, Hao Liang, Bai, Tianyi +22 · 13 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling
19. Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem?
    2025/02/17 by Zichen Wen, Wen, Zichen, Yifeng Gao +7 · 26 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
20. Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction
    2024/10/28 by Qintong Zhang, Zhang, Qintong, Bin Wang +13 · 1 voice · 13 citations
    Computer Science · #cs.MM #cs.AI #cs.CL #cs.CV
21. OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
    2024/06/12 by Qingyun Li, Zhe Chen, Li, Qingyun +75 · 13 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Music and Audio Processing #Video Analysis and Summarization
22. SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models
    2024/02/08 by Liu, Dongyang, Renrui Zhang, Zhang, Renrui +34 · 11 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
23. Rethinking Token-wise Feature Caching: Accelerating Diffusion Transformers with Dual Feature Caching
    2024/12/25 by Chang Zou, Zou, Chang, Zhang, Evelyn +9 · 17 citations
    Computer Science · Engineering · Biochemistry, Genetics and Molecular Biology · #Caching and Content Delivery #Advanced Memory and Neural Computing #DNA and Biological Computing
24. GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generation
    2025/04/03 by Zhiyuan Yan, Yan, Zhiyuan, Junyan Ye +17 · 24 citations
    Medicine · #Blood groups and transfusion #Cardiac and Coronary Surgery Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Platelet Disorders and Treatments
25. InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
    2024/12/12 by Pan Zhang, Zhang, Pan, Xiaoyi Dong +53 · 14 citations
    Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimedia Communication and Technology #Speech and dialogue systems #Video Analysis and Summarization
26. Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanation
    2025/03/19 by Junyan Ye, Wen, Siwei, Ye, Junyan +14 · 17 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques
27. UniMERNet: A Universal Network for Real-World Mathematical Expression Recognition
    2024/04/23 by Bin Wang, Wang, Bin, Zhuangcheng Gu +10 · 8 citations
    Computer Science · Mathematics · Social Sciences · #Intelligent Tutoring Systems and Adaptive Learning #Cognitive and developmental aspects of mathematical skills #Mathematics Education and Teaching Techniques
28. Harnessing Diversity for Important Data Selection in Pretraining Large Language Models
    2024/09/25 by Chi Zhang, Zhang, Chi, Huaping Zhong +23 · 9 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Natural Language Processing Techniques
29. Large Language Models Meet Symbolic Provers for Logical Reasoning Evaluation
    2025/02/10 by Chengwen Qi, Ren Ma, Qi, Chengwen +13 · 11 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Semantic Web and Ontologies
30. Image Over Text: Transforming Formula Recognition Evaluation with Character Detection Matching
    2024/09/05 by Bin Wang, Fan Wu, Wang, Bin +13 · 9 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Mathematics, Computing, and Information Processing
31. UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarios
    2024/08/30 by Baichuan Zhou, Zhou, Baichuan, Haote Yang +17 · 8 citations
    Social Sciences · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Geographic Information Systems Studies #Human Mobility and Location-Based Analysis
32. Efficient Pretraining Data Selection for Language Models via Multi-Actor Collaboration
    2024/10/10 by Tianyi Bai, Bai, Tianyi, Ling Yang +19 · 7 citations
    Computer Science · Engineering · Mathematics · #Computation and Language (cs.CL) #Engineering and Information Technology #FOS: Computer and information sciences #Manufacturing Process and Optimization #Modeling, Simulation, and Optimization
33. WanJuan: A Comprehensive Multimodal Dataset for Advancing English and Chinese Large Models
    2023/08/21 by Conghui He, Zhenjiang Jin, He, Conghui +15 · 4 citations
    Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
34. CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesis
    2024/08/27 by Weijia Li, Li, Weijia, J. He +13 · 6 citations
    Engineering · #Advanced Manufacturing and Logistics Optimization #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Satellite Image Processing and Photogrammetry #Simulation and Modeling Applications
35. MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing
    2025/09/26 by Junbo Niu, Zheng Liu, Niu, Junbo +119 · 1 voice · 15 citations
    #cs.CV #cs.CL
36. SongComposer: A Large Language Model for Lyric and Melody Generation in Song Composition
    2024/02/27 by Shuangrui Ding, Zihan Liu, Ding, Shuangrui +14 · 3 citations
    Computer Science · #Music and Audio Processing
37. GeoX: Geometric Problem Solving Through Unified Formalized Vision-Language Pre-training
    2024/12/16 by Renqiu Xia, Xia, Renqiu, Mingsheng Li +27 · 5 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Mathematics, Computing, and Information Processing
38. LongWanjuan: Towards Systematic Measurement for Long Text Quality
    2024/02/21 by Kai Lv, Lv, Kai, Xiaoran Liu +11 · 3 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
39. MIA-DPO: Multi-Image Augmented Direct Preference Optimization For Large Vision-Language Models
    2024/10/23 by Ziyu Liu, Yuhang Zang, Liu, Ziyu +17 · 4 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Constraint Satisfaction and Optimization #FOS: Computer and information sciences #Multimodal Machine Learning Applications
40. Data Whisperer: Efficient Data Selection for Task-Specific LLM Fine-Tuning via Few-Shot In-Context Learning
    2025/05/18 by Shaobo Wang, Wang, Shaobo, Jin, Xiangqi +17 · 8 citations
    Computer Science · #Topic Modeling #Speech Recognition and Synthesis #Natural Language Processing Techniques
41. BenchMAX: A Comprehensive Multilingual Evaluation Suite for Large Language Models
    2025/02/11 by Xu Huang, Wenhao Zhu, Huang, Xu +11 · 4 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
42. Parrot Captions Teach CLIP to Spot Text
    2023/12/21 by Yiqi Lin, Lin, Yiqi, Conghui He +9 · 2 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques
43. Synth-Empathy: Towards High-Quality Synthetic Empathy Data
    2024/07/31 by Hao Liang, Linzhuang Sun, Liang, Hao +13 · 2 citations
    Psychology · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mental Health Research Topics
44. WanJuan-CC: A Safe and High-Quality Open-sourced English Webtext Dataset
    2024/02/29 by Jiantao Qiu, Qiu, Jiantao, Haijun Lv +43 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
45. MathFusion: Enhancing Mathematical Problem-solving of LLM through Instruction Fusion
    2025/03/20 by Qizhi Pei, Lijun Wu, Pei, Qizhi +15 · 6 citations
    Computer Science · Engineering · #Educational Technology and Assessment #Experimental Learning in Engineering #Intelligent Tutoring Systems and Adaptive Learning
46. INTERN: A New Learning Paradigm Towards General Vision
    2021/11/16 by Jing Shao, Shao, Jing, Siyu Chen +51 · 1 citation
    Computer Science · #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications #Multimodal Machine Learning Applications
47. A Comprehensive Survey on Imbalanced Data Learning
    2025/02/13 by Xinyi Gao, Dongting Xie, Gao, Xinyi +12 · 3 citations
    Computer Science · Health Professions · #Artificial Intelligence in Healthcare #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Machine Learning (cs.LG)
48. A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers
    2025/08/28 by Mingjun Hu, Hu, Ming, Chenglong Ma +214 · 9 citations
    Computer Science · Materials Science · Medicine · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning in Materials Science #Topic Modeling
49. GRAIT: Gradient-Driven Refusal-Aware Instruction Tuning for Effective Hallucination Mitigation
    2025/02/09 by Zhu, Runchuan, Zinco Jiang, Jiang Wu +11 · 3 citations
    Medicine · Neuroscience · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hallucinations in medical conditions #Schizophrenia research and treatment #Treatment of Major Depression
50. Gradual Learning: Optimizing Fine-Tuning with Partially Mastered Knowledge in Large Language Models
    2024/10/08 by Bozhou Li, Hao Liang, Li, Bozhou +11 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
51. LEMMA: Learning from Errors for MatheMatical Advancement in LLMs
    2025/03/21 by Zhuoshi Pan, Pan, Zhuoshi, Yumin Li +16 · 4 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Open Education and E-Learning
52. OmniAID: Decoupling Semantics and Artifacts for Universal AI-Generated Image Detection in the Wild
    2025/11/11 by Yuncheng Guo, Guo, Yuncheng, Junyan Ye +12 · 3 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Digital Media Forensic Detection #Generative Adversarial Networks and Image Synthesis #cs.CV
53. BEATS: Optimizing LLM Mathematical Capabilities with BackVerify and Adaptive Disambiguate based Efficient Tree Search
    2024/09/26 by Linzhuang Sun, Sun, Linzhuang, Hao Liang +11 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mathematics, Computing, and Information Processing
54. ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training
    2024/02/28 by Le Zhuo, Zewen Chi, Zhuo, Le +13 · 1 citation
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Biomedical Text Mining and Ontologies #Biomolecules (q-bio.BM) #Computation and Language (cs.CL) #FOS: Biological sciences #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
55. Can One Domain Help Others? A Data-Centric Study on Multi-Domain Reasoning via Reinforcement Learning
    2025/07/23 by Li Yu, Li, Yu, Honglin Lin +7 · 5 citations
    Computer Science · #Reinforcement Learning in Robotics
56. Earth-Agent: Unlocking the Full Landscape of Earth Observation with Agents
    2025/09/27 by Peilin Feng, Feng, Peilin, Zhiqiang Lv +18 · 4 citations
    Computer Science · Decision Sciences · #Multi-Agent Systems and Negotiation #Scientific Computing and Data Management #Distributed and Parallel Computing Systems
57. A Survey of LLM × DATA
    2025/05/24 by Zhou, Xuanhe, Junxuan He, Wei Zhou +27 · 3 citations
    Computer Science · #Algorithms and Data Compression #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Databases (cs.DB) #FOS: Computer and information sciences #Image Processing and 3D Reconstruction #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Mathematics, Computing, and Information Processing
58. AudioMarathon: A Comprehensive Benchmark for Long-Context Audio Understanding and Efficiency in Audio LLMs
    2025/10/08 by Pingping He, He, Peize, Zichen Wen +27 · 4 citations
    Computer Science · #Music and Audio Processing #Speech and Audio Processing #Music Technology and Sound Studies
59. BLINK-Twice: You see, but do you observe? A Reasoning Benchmark on Visual Perception
    2025/10/10 by Junyan Ye, Dongzhi Jiang, Ye, Junyan +15 · 3 citations
    Computer Science · #Data Visualization and Analytics
60. Efficient Multi-modal Large Language Models via Progressive Consistency Distillation
    2025/10/01 by Zichen Wen, Shaobo Wang, Wen, Zichen +19 · 8 citations
    Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
61. MetaLadder: Ascending Mathematical Solution Quality via Analogical-Problem Reasoning Transfer
    2025/03/19 by Honglin Lin, Lin, Honglin, Pan, Zhuoshi +12 · 3 citations
    Computer Science · Psychology · #Intelligent Tutoring Systems and Adaptive Learning #Educational Games and Gamification #Innovative Teaching and Learning Methods
62. RealGen: Photorealistic Text-to-Image Generation via Detector-Guided Rewards
    2025/11/29 by Junyan Ye, Ye, Junyan, Leiqi Zhu +17 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Games #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications