Tianyu Gao
- SimCSE: Simple Contrastive Learning of Sentence Embeddings
2021/04/18 by Tianyu Gao, Xingcheng Yao, Gao, Tianyu +3 · 210 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Sentiment Analysis and Opinion Mining #Topic Modeling
- SimCSE: Simple Contrastive Learning of Sentence Embeddings
2021/01/01 by Tianyu Gao, Xingcheng Yao, Danqi Chen · 161 citations
Computer Science · #Natural Language Processing Techniques #Sentiment Analysis and Opinion Mining #Topic Modeling
- Fine-Tuning Language Models with Just Forward Passes
2023/05/27 by Sadhika Malladi, Tianyu Gao, Malladi, Sadhika +11 · 1 voice · 52 citations
Computer Science · Engineering · #Ferroelectric and Negative Capacitance Devices #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Making Pre-trained Language Models Better Few-shot Learners
2020/12/31 by Tianyu Gao, Adam Fisch, Gao, Tianyu +3 · 74 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Enabling Large Language Models to Generate Text with Citations
2023/05/24 by Tianyu Gao, H. W. Yen, Gao, Tianyu +5 · 76 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation
2019/11/13 by Xiaozhi Wang, Tianyu Gao, Wang, Xiaozhi +11 · 38 citations
Computer Science · #Advanced Graph Neural Networks #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
2023/10/10 by Mengzhou Xia, Xia, Mengzhou, Tianyu Gao +5 · 60 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughly
2024/10/03 by Howard Yen, H. W. Yen, Yen, Howard +14 · 1 voice · 31 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
- Evaluating Large Language Models at Evaluating Instruction Following
2023/10/11 by Zhiyuan Zeng, Zeng, Zhiyuan, Jiatong Yu +9 · 40 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification
- What In-Context Learning "Learns" In-Context: Disentangling Task Recognition and Task Learning
2023/05/16 by Jane Pan, Pan, Jane, Tianyu Gao +5 · 19 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- How to Train Long-Context Language Models (Effectively)
2024/10/03 by Tianyu Gao, Gao, Tianyu, Alexander Wettig +5 · 32 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- LitSearch: A Retrieval Benchmark for Scientific Literature Search
2024/07/10 by Anirudh Ajith, Ajith, Anirudh, Mengzhou Xia +9 · 22 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #Digital Libraries (cs.DL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Semantic Web and Ontologies
- Long-Context Language Modeling with Parallel Context Encoding
2024/02/26 by H. W. Yen, Yen, Howard, Tianyu Gao +3 · 17 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
- Should You Mask 15% in Masked Language Modeling?
2022/02/16 by Alexander Wettig, Wettig, Alexander, Tianyu Gao +5 · 8 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- FewRel 2.0: Towards More Challenging Few-Shot Relation Classification
2019/10/16 by Tianyu Gao, Gao, Tianyu, Xu Han +11 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Few-shot Relation Extraction via Bayesian Meta-learning on Relation Graphs
2020/07/05 by Meng Qu, Tianyu Gao, Qu, Meng +5 · 4 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Topic Modeling
- OpenNRE: An Open and Extensible Toolkit for Neural Relation Extraction
2019/09/28 by Xu Han, Han, Xu, Tianyu Gao +9 · 3 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Software Engineering Research
- Recovering Private Text in Federated Learning of Language Models
2022/05/17 by Samyak Gupta, Gupta, Samyak, Yangsibo Huang +9 · 3 citations
Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data
- Neural Snowball for Few-Shot Relation Learning
2019/08/29 by Tianyu Gao, Gao, Tianyu, Xu Han +11 · 2 citations
Computer Science · Decision Sciences · #Advanced Graph Neural Networks #Computation and Language (cs.CL) #Data Quality and Management #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction
2020/04/07 by Xu Han, Han, Xu, Tianyu Gao +17 · 5 citations
Computer Science · #Topic Modeling #Advanced Graph Neural Networks #Natural Language Processing Techniques
- Learning from Context or Names? An Empirical Study on Neural Relation Extraction
2020/10/05 by Hao Peng, Tianyu Gao, Peng, Hao +13 · 3 citations
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction
2021/05/20 by Tianyu Gao, Gao, Tianyu, Xu Han +17 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text and Document Classification Technologies #Topic Modeling
- Ditch the Gold Standard: Re-evaluating Conversational Question Answering
2021/12/16 by Huihan Li, Li, Huihan, Tianyu Gao +5 · 2 citations
Computer Science · #Topic Modeling #Speech and dialogue systems #Natural Language Processing Techniques
- LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation
2025/01/09 by Xi Ye, Ye, Xi, Fangcong Yin +12 · 4 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech and dialogue systems
- Modeling and Simulation of UAV Carrier Landings
2019/01/23 by Gaurav Misra, Tianyu Gao, Misra, Gaurav +3 · 1 citation
Engineering · #Aerospace and Aviation Technology #Aerospace Engineering and Control Systems #Adaptive Control of Nonlinear Systems
- Improving Language Understanding from Screenshots
2024/02/21 by Tianyu Gao, Gao, Tianyu, Zi-Rui Wang +5 · 2 citations
Computer Science · Social Sciences · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia Communication and Technology #Speech and dialogue systems