Al-Rfou, Rami

1. MotionLM: Multi-Agent Motion Forecasting as Language Modeling
   2023/09/28 by Ari Seff, Brian Cera, Seff, Ari +16 · 3 voices · 28 citations
   Engineering · #Autonomous Vehicle Technology and Safety #cs.AI #cs.CV #cs.LG #cs.RO
2. The Power of Scale for Parameter-Efficient Prompt Tuning
   2021/04/18 by Lester, Brian, Al-Rfou, Rami, Constant, Noah · 307 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
3. mT5: A massively multilingual pre-trained text-to-text transformer
   2020/10/22 by Xue, Linting, Constant, Noah, Roberts, Adam +5 · 135 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
4. ByT5: Towards a token-free future with pre-trained byte-to-byte models
   2021/05/28 by Linting Xue, Aditya Barua, Xue, Linting +14 · 1 voice · 47 citations
   Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL
5. Wayformer: Motion Forecasting via Simple & Efficient Attention Networks
   2022/07/12 by Nigamaa Nayakanti, Nayakanti, Nigamaa, Rami Al‐Rfou +9 · 29 citations
   Computer Science · Engineering · #Autonomous Vehicle Technology and Safety #Computer Vision and Pattern Recognition (cs.CV) #Data Visualization and Analytics #FOS: Computer and information sciences #Time Series Analysis and Forecasting
6. Efficient Natural Language Response Suggestion for Smart Reply
   2017/05/01 by Henderson, Matthew, Al-Rfou, Rami, Strope, Brian +6 · 17 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
7. Let Your Graph Do the Talking: Encoding Structured Data for LLMs
   2024/02/08 by Bryan Perozzi, Bahare Fatemi, Perozzi, Bryan +11 · 19 citations
   Biochemistry, Genetics and Molecular Biology · Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Biomedical Text Mining and Ontologies #FOS: Computer and information sciences #I.2.6 #I.2.7 #I.5.1 #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Scientific Computing and Data Management #Semantic Web and Ontologies #Social and Information Networks (cs.SI)
8. SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer
   2021/10/15 by Tu Vu, Vu, Tu, Brian Lester +7 · 9 citations
   Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Topic Modeling
9. Character-Level Language Modeling with Deeper Self-Attention
   2018/08/09 by Al-Rfou, Rami, Choe, Dokook, Constant, Noah +2 · 3 citations
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
10. VN-Transformer: Rotation-Equivariant Attention for Vector Neurons
    2022/06/08 by Serge Assaad, Carlton Downey, Assaad, Serge +7 · 4 citations
    Computer Science · Engineering · #Optical measurement and interference techniques #Image Processing and 3D Reconstruction #Advanced Measurement and Metrology Techniques
11. Bridging the Gap for Tokenizer-Free Language Models
    2019/08/27 by Dokook Choe, Rami Al‐Rfou, Choe, Dokook +7 · 3 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
12. Statistically Significant Detection of Linguistic Change
    2014/11/12 by Vivek Kulkarni, Kulkarni, Vivek, Rami Al‐Rfou +5 · 2 citations
    Computer Science · Social Sciences · #Authorship Attribution and Profiling #Computation and Language (cs.CL) #FOS: Computer and information sciences #H.3.3 #I.2.6 #Information Retrieval (cs.IR) #Language and cultural evolution #Machine Learning (cs.LG) #Natural Language Processing Techniques
13. MoST: Multi-modality Scene Tokenization for Motion Prediction
    2024/04/30 by Norman Mu, Mu, Norman, Jingwei Ji +25 · 5 citations
    Computer Science · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Video Analysis and Summarization
14. LAReQA: Language-agnostic answer retrieval from a multilingual pool
    2020/04/11 by Roy, Uma, Constant, Noah, Al-Rfou, Rami +3 · 2 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
15. The Expressive Power of Word Embeddings
    2013/01/15 by Chen, Yanqing, Perozzi, Bryan, Al-Rfou, Rami +1 · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
16. Polyglot: Distributed Word Representations for Multilingual NLP
    2013/07/05 by Al-Rfou, Rami, Perozzi, Bryan, Skiena, Steven · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
17. Theano: A Python framework for fast computation of mathematical expressions
    2016/05/09 by The Theano Development Team, Al-Rfou, Rami, Alain, Guillaume +110 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mathematical Software (cs.MS) #Symbolic Computation (cs.SC)
18. Scaling Laws of Motion Forecasting and Planning -- Technical Report
    2025/06/09 by Mustafa Baniodeh, Baniodeh, Mustafa, Kratarth Goel +31 · 7 citations
    Engineering · Computer Science · #Autonomous Vehicle Technology and Safety #Multimodal Machine Learning Applications #Human Motion and Animation
19. Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecasting
    2022/06/08 by Su, DiJia, Douillard, Bertrand, Al-Rfou, Rami +2 · 1 citation
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)