Zhang, Jieyu
- AIKernel Semantic DSL Compiler and Deterministic Agent Execution Architecture
2023/08/16 by Gagan Bansal, Wu, Qingyun, Jieyu Zhang +20 · 335 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multi-Agent Systems and Negotiation #Natural Language Processing Techniques #Semantic Web and Ontologies
- DataComp-LM: In search of the next generation of training sets for language models
2024/06/17 by Jeffrey Li, Alex Chengyu Fang, Li, Jeffrey +121 · 2 voices · 79 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- DataComp: In search of the next generation of multimodal datasets
2023/04/27 by Samir Yitzhak Gadre, Gadre, Samir Yitzhak, Gabriel Ilharco +65 · 78 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
- SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models
2023/07/20 by Xiaoxuan Wang, Wang, Xiaoxuan, Ziniu Hu +17 · 40 citations
Computer Science · Psychology · Social Sciences · #Online Learning and Analytics #Educational Strategies and Epistemologies #Education and Critical Thinking Development
- SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionality
2023/06/26 by Cheng-Yu Hsieh, Jieyu Zhang, Hsieh, Cheng-Yu +7 · 36 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Text Readability and Simplification #Topic Modeling
- xGen-MM (BLIP-3): A Family of Open Large Multimodal Models
2024/08/16 by Le Xue, Manli Shu, Xue, Le +57 · 32 citations
Computer Science · #Speech and dialogue systems #Multi-Agent Systems and Negotiation
- EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Records
2024/01/13 by Wenqi Shi, Shi, Wenqi, Ran Xu +17 · 19 citations
Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning in Healthcare #Topic Modeling
- m&m's: A Benchmark to Evaluate Tool-Use for multi-step multi-modal Tasks
2024/03/17 by Zixian Ma, Ma, Zixian, Weikai Huang +7 · 12 citations
Computer Science · #Speech and dialogue systems
- MindCube: Spatial Mental Modeling from Limited Views
2025/06/26 by Yin, Baiqiao, Wang, Qineng, Pingyue Zhang +20 · 34 citations
Computer Science · Engineering · Social Sciences · #Artificial Intelligence (cs.AI) #Cognitive Science and Mapping #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Geographic Information Systems Studies #Spatial Cognition and Navigation
- MolmoAct: Action Reasoning Models that can Reason in Space
2025/08/11 by Jason Lee, Jiafei Duan, Lee, Jason +34 · 48 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems
2025/04/30 by Zhang, Shaokun, Yin, Ming, Zhang, Jieyu +8 · 26 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Multiagent Systems (cs.MA)
- Offline Training of Language Model Agents with Functions as Learnable Weights
2024/02/17 by Shaokun Zhang, Zhang, Shaokun, Jieyu Zhang +11 · 9 citations
Computer Science · #Natural Language Processing Techniques
- Adaptive In-conversation Team Building for Language Model Agents
2024/05/29 by Song, Linxin, Liu, Jiale, Zhang, Jieyu +5 · 10 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Explaining Length Bias in LLM-Based Preference Evaluations
2024/07/01 by Hu, Zhengyu, Song, Linxin, Zhang, Jieyu +7 · 9 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Adaptive Ranking-based Sample Selection for Weakly Supervised Class-imbalanced Text Classification
2022/10/06 by Linxin Song, Jieyu Zhang, Song, Linxin +5 · 5 citations
Computer Science · #Imbalanced Data Classification Techniques #Text and Document Classification Technologies #Topic Modeling
- Nemotron-Research-Tool-N1: Exploring Tool-Using Language Models with Reinforced Reasoning
2025/04/25 by Shaokun Zhang, Zhang, Shaokun, Yi Dong +15 · 18 citations
Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Subclass-balancing Contrastive Learning for Long-tailed Recognition
2023/06/28 by Hou, Chengkai, Zhang, Jieyu, Wang, Haonan +1 · 5 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Single-Pass Contrastive Learning Can Work for Both Homophilic and Heterophilic Graph
2022/11/20 by Haonan Wang, Wang, Haonan, Jieyu Zhang +7 · 4 citations
Computer Science · Social Sciences · #Advanced Graph Neural Networks #E-Government and Public Services #FOS: Computer and information sciences #Machine Learning (cs.LG) #Social and Information Networks (cs.SI)
- A Survey on Graph Structure Learning: Progress and Opportunities
2021/03/04 by Zhu, Yanqiao, Xu, Weizhi, Zhang, Jinghao +5 · 3 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Social and Information Networks (cs.SI)
- LATTE: Learning to Think with Vision Specialists
2024/12/07 by Zixian Ma, Jianguo Zhang, Ma, Zixian +21 · 8 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- A Survey on Deep Graph Generation: Methods and Applications
2022/03/13 by Yanqiao Zhu, Zhu, Yanqiao, Yuanqi Du +11 · 3 citations
Computer Science · #Advanced Graph Neural Networks #FOS: Biological sciences #FOS: Computer and information sciences #Machine Learning (cs.LG) #Molecular Networks (q-bio.MN) #Social and Information Networks (cs.SI) #Text and Document Classification Technologies #Topic Modeling
- When to Learn What: Model-Adaptive Data Augmentation Curriculum
2023/09/09 by Hou, Chengkai, Zhang, Jieyu, Zhou, Tianyi · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- On the Trustworthiness of Generative Foundation Models: Guideline, Assessment, and Perspective
2025/02/20 by Huang, Yue, Gao, Chujie, Wu, Siyuan +63 · 8 citations
#Computers and Society (cs.CY) #FOS: Computer and information sciences
- Biomedical Visual Instruction Tuning with Clinician Preference Alignment
2024/06/19 by Cui, Hejie, Mao, Lingjun, Liang, Xin +5 · 4 citations
#68T05 #68T07 #68T09 #68T37 #68T45 #68T50 #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #I.2.10 #I.2.6 #I.2.7 #Machine Learning (cs.LG)
- WRENCH: A Comprehensive Benchmark for Weak Supervision
2021/09/23 by Zhang, Jieyu, Yu, Yue, Li, Yinghao +4 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Task Me Anything
2024/06/17 by Jieyu Zhang, Weikai Huang, Zhang, Jieyu +17 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- EcoAct: Economic Agent Determines When to Register What Action
2024/11/03 by Shaokun Zhang, Zhang, Shaokun, Jieyu Zhang +16 · 5 citations
Decision Sciences · Economics, Econometrics and Finance · #Artificial Intelligence (cs.AI) #Complex Systems and Decision Making #Computation and Language (cs.CL) #Economic Theory and Institutions #Economic theories and models #FOS: Computer and information sciences
- EcoAssistant: Using LLM Assistant More Affordably and Accurately
2023/10/03 by Zhang, Jieyu, Krishna, Ranjay, Awadallah, Ahmed H. +1 · 3 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Software Engineering (cs.SE)
- Iterated Learning Improves Compositionality in Large Vision-Language Models
2024/04/02 by Zheng, Chenhao, Zhang, Jieyu, Kembhavi, Aniruddha +1 · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Uncovering Neural Scaling Laws in Molecular Representation Learning
2023/09/15 by Chen, Dingshuo, Zhu, Yanqiao, Zhang, Jieyu +5 · 2 citations
#Chemical Physics (physics.chem-ph) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG)
- ProVision: Programmatically Scaling Vision-centric Instruction Data for Multimodal Language Models
2024/12/09 by Jieyu Zhang, Le Xue, Zhang, Jieyu +25 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Speech and dialogue systems
- CoAct-1: Computer-using Multi-Agent System with Coding Actions
2025/08/05 by Li Song, Song, Linxin, Yutong Dai +21 · 9 citations
Computer Science · #Multi-Agent Systems and Negotiation
- Relation Learning on Social Networks with Multi-Modal Graph Edge Variational Autoencoders
2019/11/04 by Yang, Carl, Zhang, Jieyu, Wang, Haonan +5 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Social and Information Networks (cs.SI)
- LLMs-based Few-Shot Disease Predictions using EHR: A Novel Approach Combining Predictive Agent Reasoning and Critical Agent Instruction
2024/03/19 by Cui, Hejie, Shen, Zhuocheng, Zhang, Jieyu +4 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #J.3 #Machine Learning (cs.LG) #Multiagent Systems (cs.MA)
- H2R: A Human-to-Robot Data Augmentation for Robot Pre-training from Videos
2025/05/17 by Guowen Li, Li, Guangrun, Lyu, Yaoxu +8 · 5 citations
Computer Science · Psychology · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Social Robot Interaction and HRI
- A Survey on Programmatic Weak Supervision
2022/02/11 by Jieyu Zhang, Cheng-Yu Hsieh, Zhang, Jieyu +7 · 1 citation
Computer Science · #Machine Learning and Data Classification #Machine Learning and Algorithms #Image Retrieval and Classification Techniques
- Towards Acyclic Preference Evaluation of Language Models via Multiple Evaluators
2024/10/14 by Zhengyu Hu, Jieyu Zhang, Hu, Zhengyu +7 · 2 citations
Computer Science · #Natural Language Processing Techniques
- Generate Any Scene: Scene Graph Driven Data Synthesis for Visual Generation Training
2024/12/11 by Ziqi Gao, Weikai Huang, Gao, Ziqi +7 · 3 citations
Psychology · Computer Science · #Educational Games and Gamification #Multimodal Machine Learning Applications #Topic Modeling
- On the Trade-off of Intra-/Inter-class Diversity for Supervised Pre-training
2023/05/20 by Jieyu Zhang, Bohan Wang, Zhang, Jieyu +7 · 1 citation
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification
- NLPBench: Evaluating Large Language Models on Solving NLP Problems
2023/09/27 by Song, Linxin, Zhang, Jieyu, Cheng, Lechao +3 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- How Many Validation Labels Do You Need? Exploring the Design Space of Label-Efficient Model Ranking
2023/12/04 by Hu, Zhengyu, Zhang, Jieyu, Yu, Yue +2 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- One Trajectory, One Token: Grounded Video Tokenization via Panoptic Sub-object Trajectory
2025/05/29 by Zheng, Chenhao, Zhang, Jieyu, Salehi, Mohammadreza +5 · 2 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Machine Learning (cs.LG)
- Frustratingly Easy Regularization on Representation Can Boost Deep Reinforcement Learning
2022/05/29 by Qiang He, Huangyuan Su, He, Qiang +5 · 1 citation
Computer Science · Engineering · #Advanced Memory and Neural Computing #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics
- Investigating the Scaling Effect of Instruction Templates for Training Multimodal Language Model
2024/12/11 by Wang, Shijian, Song, Linxin, Zhang, Jieyu +9 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences