Wu, Ziyang
- White-Box Transformers via Sparse Rate Reduction
2023/06/01 by Yaodong Yu, Sam Buchanan, Yu, Yaodong +13 · 15 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- When Do We Not Need Larger Vision Models?
2024/03/19 by Baifeng Shi, Ziyang Wu, Shi, Baifeng +7 · 9 citations
Earth and Planetary Sciences · #3D Surveying and Cultural Heritage #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is?
2023/11/22 by Yaodong Yu, Yu, Yaodong, Sam Buchanan +17 · 5 citations
Computer Science · #Image and Signal Denoising Methods #Generative Adversarial Networks and Image Synthesis #Advanced Data Compression Techniques
- Emergence of Segmentation with Minimalistic White-Box Transformers
2023/08/30 by Yu, Yaodong, Chu, Tianzhe, Tong, Shengbang +4 · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Simplifying DINO via Coding Rate Regularization
2025/02/14 by Ziyang Wu, Wu, Ziyang, Jingyuan Zhang +13 · 6 citations
Computer Science · #Advanced Data Compression Techniques
- Masked Completion via Structured Diffusion with White-Box Transformers
2024/04/03 by Druv Pai, Ziyang Wu, Pai, Druv +7 · 3 citations
Engineering · #Architecture and Computational Design #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- LLoCO: Learning Long Contexts Offline
2024/04/11 by Sijun Tan, Xiuyu Li, Tan, Sijun +13 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- PARN: Position-Aware Relation Networks for Few-Shot Learning
2019/09/10 by Ziyang Wu, Wu, Ziyang, Yuwei Li +5 · 1 citation
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- How Low Can We Go: Trading Memory for Error in Low-Precision Training
2021/06/17 by Yang, Chengrun, Wu, Ziyang, Chee, Jerry +2 · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Token Statistics Transformer: Linear-Time Attention via Variational Rate Reduction
2024/12/23 by Wu, Ziyang, Ding, Tianjiao, Lu, Yifu +6 · 3 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Incremental Learning via Rate Reduction
2020/11/30 by Wu, Ziyang, Baek, Christina, You, Chong +1 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- TenIPS: Inverse Propensity Sampling for Tensor Completion
2021/01/01 by Chengrun Yang, Lijun Ding, Yang, Chengrun +5 · 1 citation
Engineering · Mathematics · Medicine · #Advanced Neuroimaging Techniques and Applications #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Tensor decomposition and applications
- Incremental Learning of Structured Memory via Closed-Loop Transcription
2022/02/11 by Tong, Shengbang, Dai, Xili, Wu, Ziyang +3 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Spatial-Temporal Mixture-of-Graph-Experts for Multi-Type Crime Prediction
2024/09/24 by Wu, Ziyang, Liu, Fan, Han, Jindong +2 · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)