Zheng, Zangwei
- Open-Sora: Democratizing Efficient Video Production for All
2024/12/29 by Z. Zheng, Xiangyu Peng, Zheng, Zangwei +14 · 157 citations
Environmental Science · #Urban Planning and Valuation
- OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models
2024/01/29 by Xue, Fuzhao, Zheng, Zian, Fu, Yao +4 · 33 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200k
2025/03/12 by Peng, Xiangyu, Zheng, Zangwei, Shen, Chenhui +29 · 56 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Graphics (cs.GR)
- Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline
2023/05/22 by Zangwei Zheng, Xiaozhe Ren, Zheng, Zangwei +9 · 19 citations
Computer Science · Materials Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning in Materials Science
- Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Models
2023/03/12 by Zangwei Zheng, Zheng, Zangwei, Mingyuan Ma +9 · 14 citations
Computer Science · Medicine · #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- To Repeat or Not To Repeat: Insights from Scaling LLM under Token-Crisis
2023/05/22 by Fuzhao Xue, Xue, Fuzhao, Yao Fu +7 · 10 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Prototypical Cross-domain Self-supervised Learning for Few-shot Unsupervised Domain Adaptation
2021/03/31 by Xiangyu Yue, Yue, Xiangyu, Zangwei Zheng +11 · 7 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Cancer-related molecular mechanisms research #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- CAME: Confidence-guided Adaptive Memory Efficient Optimization
2023/07/05 by Yang Luo, Luo, Yang, Xiaozhe Ren +9 · 6 citations
Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning and Data Classification
- InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruning
2023/03/08 by Qin, Ziheng, Wang, Kai, Zheng, Zangwei +8 · 5 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Prompt Vision Transformer for Domain Generalization
2022/08/18 by Zangwei Zheng, Xiangyu Yue, Zheng, Zangwei +5 · 2 citations
Computer Science · Engineering · #Domain Adaptation and Few-Shot Learning #Machine Learning and ELM #Remote-Sensing Image Classification
- DSP: Dynamic Sequence Parallelism for Multi-Dimensional Transformers
2024/03/15 by Zhao, Xuanlei, Cheng, Shenggan, Chen, Chang +4 · 3 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Cross-token Modeling with Conditional Computation
2021/09/05 by Yuxuan Lou, Lou, Yuxuan, Fuzhao Xue +5 · 1 citation
Computer Science · Neuroscience · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Brain Tumor Detection and Classification #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)
- How Does the Textual Information Affect the Retrieval of Multimodal In-Context Learning?
2024/04/19 by Yang Luo, Luo, Yang, Zangwei Zheng +5 · 1 citation
Arts and Humanities · Psychology · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #EFL/ESL Teaching and Learning #Educational Strategies and Epistemologies #FOS: Computer and information sciences #Second Language Acquisition and Learning