Kydlíček, Hynek
- The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
2024/06/25 by Guilherme Penedo, Hynek Kydlíček, Penedo, Guilherme +14 · 2 voices · 356 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Mathematics, Computing, and Information Processing #Natural Language Processing Techniques #cs.CL
- SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
2025/02/04 by Loubna Ben Allal, Anton Lozhkov, Allal, Loubna Ben +41 · 5 voices · 122 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
- FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
2025/06/26 by Guilherme Penedo, Penedo, Guilherme, Hynek Kydlíček +17 · 1 voice · 38 citations
Computer Science · #Computation and Language (cs.CL) #Educational Technology and Assessment #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Online Learning and Analytics
- Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs
2025/02/18 by Longxu Dou, Qian Liu, Dou, Longxu +82 · 1 voice · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #cs.AI #cs.CL #cs.LG
- Towards Best Practices for Open Datasets for LLM Training
2025/01/14 by Stefan Baack, Stella Biderman, Baack, Stefan +79 · 3 voices · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #cs.AI #cs.CL #cs.CY #cs.LG