Yang, Andy
- Masked Hard-Attention Transformers Recognize Exactly the Star-Free Languages
2023/10/21 by Andy Yang, David Chiang, Yang, Andy +3 · 10 citations
Computer Science · #Cellular Automata and Applications #FOS: Computer and information sciences #Formal Languages and Automata Theory (cs.FL) #Formal Methods in Verification #Logic in Computer Science (cs.LO) #Machine Learning (cs.LG) #semigroups and automata theory
- A Formal Framework for Understanding Length Generalization in Transformers
2024/10/03 by Huang, Xinting, Yang, Andy, Bhattamishra, Satwik +5 · 10 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Counting Like Transformers: Compiling Temporal Counting Logic Into Softmax Transformers
2024/04/05 by Yang, Andy, Chiang, David · 8 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Formal Languages and Automata Theory (cs.FL) #Logic in Computer Science (cs.LO) #Machine Learning (cs.LG)
- Simulating Hard Attention Using Soft Attention
2024/12/13 by Andy Yang, Yang, Andy, Lena Strobl +5 · 1 voice · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Formal Languages and Automata Theory (cs.FL) #Machine Learning (cs.LG) #cs.CL #cs.FL #cs.LG
- The Transformer Cookbook
2025/10/01 by Andy Yang, Christopher Watson, Yang, Andy +15 · 1 voice · 1 citation
#cs.LG