Jinfeng Rao

1. Transcending Scaling Laws with 0.1% Extra Compute
   2022/10/20 by Yi Tay, Tay, Yi, Jason Wei +31 · 2 voices · 5 citations
   Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling #cs.AI #cs.CL #cs.LG
2. Long Range Arena: A Benchmark for Efficient Transformers
   2020/11/08 by Yi Tay, Tay, Yi, Mostafa Dehghani +17 · 109 citations
   Computer Science · Engineering · #Advanced Neural Network Applications #Ferroelectric and Negative Capacitance Devices #Power Line Inspection Robots
3. Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
   2022/07/21 by Yi Tay, Tay, Yi, Mostafa Dehghani +17 · 1 voice · 11 citations
   Computer Science · Physics and Astronomy · #Complex Network Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Theoretical and Computational Physics #cs.CL #cs.LG
4. Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers
   2021/09/22 by Yi Tay, Mostafa Dehghani, Tay, Yi +17 · 17 citations
   Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
5. Improving Pinterest Search Relevance Using Large Language Models
   2024/10/22 by Han Wang, Wang, Han, Mukuntha Narayanan Sundararaman +15 · 2 voices · 5 citations
   Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Web Data Mining and Analysis #cs.CL #cs.IR
6. Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks
   2019/06/11 by Yi Tay, Aston Zhang, Tay, Yi +13 · 6 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
7. DSI++: Updating Transformer Memory with New Documents
   2022/12/19 by Sanket Vaibhav Mehta, Jai Prakash Gupta, Mehta, Sanket Vaibhav +15 · 7 citations
   Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning
8. ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning
   2021/11/22 by Vamsi Aribandi, Aribandi, Vamsi, Yi Tay +25 · 5 citations
   Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
9. Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives
   2019/05/26 by Yi Tay, Shuohang Wang, Tay, Yi +15 · 4 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling