Szymon Tworkowski

1. Hierarchical Transformers Are More Efficient Language Models
   2021/10/26 by Piotr Nawrot, Szymon Tworkowski, Nawrot, Piotr +11 · 4 voices · 19 citations
   Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Natural Language Processing Techniques
2. Focused Transformer: Contrastive Training for Context Scaling
   2023/07/06 by Szymon Tworkowski, Konrad Staniszewski, Tworkowski, Szymon +9 · 8 citations
   Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Natural Language Processing Techniques
3. Magnushammer: A Transformer-Based Approach to Premise Selection
   2023/03/08 by Maciej Mikuła, Szymon Tworkowski, Mikuła, Maciej +16 · 6 citations
   Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Logic in Computer Science (cs.LO) #Machine Learning (cs.LG) #Neural Networks and Applications
4. Analysing The Impact of Sequence Composition on Language Model Pre-Training
   2024/01/01 by Yu Zhao, Yuanbin Qu, Konrad Staniszewski +5 · 1 voice · 3 citations
   Computer Science · #Natural Language Processing Techniques #cs.CL