Shen, Tao
- A Survey on Knowledge Distillation of Large Language Models
2024/02/20 by Xiaohan Xu, Xu, Xiaohan, Ming Li +15 · 48 citations
Computer Science · #Topic Modeling
- Interpretable RNA Foundation Model from Unannotated Data for Highly Accurate RNA Structure and Function Predictions
2022/04/01 by Jiayang Chen, Zhigang Hu, Chen, Jiayang +20 · 15 citations
Biochemistry, Genetics and Molecular Biology · #FOS: Biological sciences #Machine Learning in Bioinformatics #Quantitative Methods (q-bio.QM) #RNA and protein synthesis mechanisms #RNA modifications and cancer
- Thread of Thought Unraveling Chaotic Contexts
2023/11/15 by Yucheng Zhou, Xiubo Geng, Zhou, Yucheng +11 · 17 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- EventBERT: A Pre-Trained Model for Event Correlation Reasoning
2021/10/13 by Zhou, Yucheng, Geng, Xiubo, Shen, Tao +2 · 9 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Dual-Personalizing Adapter for Federated Foundation Models
2024/03/28 by Yiyuan Yang, Yang, Yiyuan, Guodong Long +7 · 13 citations
Computer Science · #Advanced Database Systems and Queries #Data Management and Algorithms #Distributed and Parallel Computing Systems
- DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understanding
2017/09/14 by Tao Shen, Shen, Tao, Tianyi Zhou +9 · 10 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Federated Unsupervised Representation Learning
2020/10/18 by Zhang, Fengda, Kuang, Kun, You, Zhaoyang +6 · 6 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Model Tailor: Mitigating Catastrophic Forgetting in Multi-modal Large Language Models
2024/02/19 by Didi Zhu, Zhongyi Sun, Zhu, Didi +13 · 10 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI
2021/11/11 by Yao, Jiangchao, Zhang, Shengyu, Yao, Yang +15 · 6 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classification
2022/03/04 by Yucheng Zhou, Tao Shen, Zhou, Yucheng +7 · 6 citations
Computer Science · #Advanced Graph Neural Networks #Bayesian Modeling and Causal Inference #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
- Re-Reading Improves Reasoning in Large Language Models
2023/09/12 by Xiaohan Xu, Chongyang Tao, Xu, Xiaohan +12 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Large Language Models are Strong Zero-Shot Retriever
2023/04/27 by Shen, Tao, Long, Guodong, Geng, Xiubo +3 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- PCL: Peer-Contrastive Learning with Diverse Augmentations for Unsupervised Sentence Embeddings
2022/01/28 by Qiyu Wu, Wu, Qiyu, Chongyang Tao +9 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Towards Robust Ranker for Text Retrieval
2022/06/16 by Zhou, Yucheng, Shen, Tao, Geng, Xiubo +5 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- LLMs are Also Effective Embedding Models: An In-depth Overview
2024/12/17 by Chongyang Tao, Tao Shen, Tao, Chongyang +11 · 9 citations
Business, Management and Accounting · Social Sciences · #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences #Financial Distress and Bankruptcy Prediction
- Fine-Grained Distillation for Long Document Retrieval
2022/12/20 by Yucheng Zhou, Tao Shen, Zhou, Yucheng +11 · 4 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Information Retrieval (cs.IR) #Topic Modeling
- Leveraging Large Language Models for NLG Evaluation: Advances and Challenges
2024/01/13 by Li, Zhen, Xu, Xiaohan, Shen, Tao +5 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Synergistic Interplay between Search and Large Language Models for Information Retrieval
2023/05/12 by Jiazhan Feng, Chongyang Tao, Feng, Jiazhan +13 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Information Retrieval and Search Behavior #Topic Modeling
- Bi-Directional Block Self-Attention for Fast and Memory-Efficient\n Sequence Modeling
2018/04/03 by Tao Shen, Tianyi Zhou, Shen, Tao +7 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text and Document Classification Technologies #Topic Modeling
- Meta-Task Prompting Elicits Embeddings from Large Language Models
2024/02/28 by Yibin Lei, Lei, Yibin, Di Wu +11 · 4 citations
Computer Science · #Topic Modeling
- Federated Mutual Learning
2020/06/27 by Tao Shen, Jie Zhang, Shen, Tao +13 · 2 citations
Computer Science · #Cryptography and Data Security #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
- Federated Graph Learning -- A Position Paper
2021/05/24 by Huanding Zhang, Tao Shen, Zhang, Huanding +9 · 2 citations
Computer Science · #Advanced Graph Neural Networks #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #Privacy-Preserving Technologies in Data #Recommender Systems and Techniques #and Cluster Computing (cs.DC)
- LexMAE: Lexicon-Bottlenecked Pretraining for Large-Scale Retrieval
2022/08/31 by Shen, Tao, Geng, Xiubo, Tao, Chongyang +5 · 2 citations
#FOS: Computer and information sciences #Information Retrieval (cs.IR)
- UnifieR: A Unified Retriever for Large-Scale Retrieval
2022/05/23 by Tao Shen, Xiubo Geng, Shen, Tao +10 · 2 citations
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- Realizing downstream access network using continuous-variable quantum key distribution
2021/07/05 by Yundi Huang, Huang, Yundi, Tao Shen +11 · 2 citations
Computer Science · Physics and Astronomy · #FOS: Physical sciences #Quantum Computing Algorithms and Architecture #Quantum Information and Cryptography #Quantum Mechanics and Applications #Quantum Physics (quant-ph)
- FedCFA: Alleviating Simpson's Paradox in Model Aggregation with Counterfactual Federated Learning
2024/12/25 by Zhonghua Jiang, Jiang, Zhonghua, Jimin Xu +13 · 5 citations
Computer Science · #FOS: Computer and information sciences #Internet Traffic Analysis and Secure E-voting #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data
- Will LLMs Scaling Hit the Wall? Breaking Barriers via Distributed Resources on Massive Edge Devices
2025/03/11 by Shen, Tao, Zhu, Didi, Zhao, Ziyu +3 · 6 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Tensorized Self-Attention: Efficiently Modeling Pairwise and Global Dependencies Together
2018/05/02 by Shen, Tao, Zhou, Tianyi, Long, Guodong +2 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
2025/01/25 by Ziyu Zhao, Zhao, Ziyu, Yixiao Zhou +20 · 4 citations
Computer Science · #Anomaly Detection Techniques and Applications #Gaussian Processes and Bayesian Inference #Machine Learning and Data Classification
- Corpus-Steered Query Expansion with Large Language Models
2024/02/28 by Yibin Lei, Yu Cao, Lei, Yibin +7 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
- Self-Attention Enhanced Selective Gate with Entity-Aware Embedding for Distantly Supervised Relation Extraction
2019/11/27 by Li, Yang, Long, Guodong, Shen, Tao +4 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- A Survey of Large Language Models in Psychotherapy: Current Landscape and Future Directions
2025/02/16 by Na, Hongbin, Hua, Yining, Wang, Zimu +6 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Enhancing Lexicon-Based Text Embeddings with Large Language Models
2025/01/16 by Lei, Yibin, Shen, Tao, Cao, Yu +1 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- Sequential Diagnosis Prediction with Transformer and Ontological Representation
2021/09/07 by Xueping Peng, Guodong Long, Peng, Xueping +7 · 1 citation
Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Chronic Disease Management Strategies #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
- DeepNoise: Signal and Noise Disentanglement based on Classifying Fluorescent Microscopy Images via Deep Learning
2022/09/13 by Sen Yang, Tao Shen, Yang, Sen +13 · 1 citation
Biochemistry, Genetics and Molecular Biology · Engineering · #Advanced Fluorescence Microscopy Techniques #Cell Image Analysis Techniques #FOS: Electrical engineering #Image Processing Techniques and Applications #Image and Video Processing (eess.IV) #electronic engineering #information engineering
- Optimal Treatment Regimes for Proximal Causal Learning
2022/12/19 by Shen, Tao, Cui, Yifan · 1 citation
#FOS: Computer and information sciences #Machine Learning (stat.ML) #Methodology (stat.ME)
- BianCang: A Traditional Chinese Medicine Large Language Model
2024/11/17 by Sibo Wei, Xueping Peng, Wei, Sibo +16 · 2 citations
Medicine · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Traditional Chinese Medicine Studies
- Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Data
2023/01/22 by Shengchao Chen, Chen, Shengchao, Guodong Long +5 · 2 citations
Environmental Science · #Hydrological Forecasting Using AI
- Adam: Dense Retrieval Distillation with Adaptive Dark Examples
2022/12/20 by Tao, Chongyang, Liu, Chang, Shen, Tao +4 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class Classification
2022/11/11 by Li, Yang, Xu, Canran, Long, Guodong +3 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Federated Prompt Learning for Weather Foundation Models on Devices
2023/05/23 by Shengchao Chen, Chen, Shengchao, Guodong Long +5 · 2 citations
Environmental Science · Physics and Astronomy · Social Sciences · #Complex Network Analysis Techniques #FOS: Computer and information sciences #Human Mobility and Location-Based Analysis #Hydrological Forecasting Using AI #Machine Learning (cs.LG)
- Accurate Prediction of Antibody Function and Structure Using Bio-Inspired Antibody Language Model
2023/08/31 by Hongtai Jing, Jing, Hongtai, Zhengtao Gao +17 · 1 citation
Biochemistry, Genetics and Molecular Biology · Medicine · #Biomolecules (q-bio.BM) #FOS: Biological sciences #Glycosylation and Glycoproteins Research #Monoclonal and Polyclonal Antibodies Research #vaccines and immunoinformatics approaches
- Improving Model Fusion by Training-time Neuron Alignment with Fixed Neuron Anchors
2024/02/02 by Zexi Li, Li, Zexi, Zhiqi Li +9 · 1 citation
Engineering · #Machine Fault Diagnosis Techniques #Fire Detection and Safety Systems
- ThinkQE: Query Expansion via an Evolving Thinking Process
2025/06/10 by Yibin Lei, Lei, Yibin, Tao Shen +3 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Information Retrieval and Search Behavior #Topic Modeling #Web Data Mining and Analysis
- FlowerTune: A Cross-Domain Benchmark for Federated Fine-Tuning of Large Language Models
2025/06/03 by Yan Gao, Massimo Roberto Scamarcia, Gao, Yan +39 · 3 citations
Computer Science · #Privacy-Preserving Technologies in Data
- Retrieval-Augmented Mixture of LoRA Experts for Uploadable Machine Learning
2024/06/24 by Ziyu Zhao, Zhao, Ziyu, Leilei Gan +13 · 1 citation
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Seismology and Earthquake Studies
- MineAgent: Towards Remote-Sensing Mineral Exploration with Multimodal Large Language Models
2024/12/23 by Beibei Yu, Tao Shen, Yu, Beibei +7 · 1 citation
Computer Science · #Geochemistry and Geologic Mapping #Natural Language Processing Techniques #Topic Modeling
- Multi-Session Client-Centered Treatment Outcome Evaluation in Psychotherapy
2024/10/08 by Na, Hongbin, Shen, Tao, Yu, Shumao +1 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Reinforced Self-Attention Network: a Hybrid of Hard and Soft Attention for Sequence Modeling
2018/01/31 by Tao Shen, Shen, Tao, Tianyi Zhou +9 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling