Kirchenbauer, John
- A Watermark for Large Language Models
2023/01/24 by John Kirchenbauer, Jonas Geiping, Kirchenbauer, John +9 · 9 voices · 148 citations
Computer Science · #Adversarial Robustness in Machine Learning #Hate Speech and Cyberbullying Detection #Topic Modeling #cs.CL #cs.CR #cs.LG
- Latent Iteration as Renormalization: Inference-Time Recurrence in a Depth-Recurrent Transformer Flows Attention Geometry Toward the SYK Conformal Fixed Point
2025/02/07 by Jonas Geiping, Geiping, Jonas, Sean McLeish +16 · 25 voices · 109 citations
Computer Science · #Advanced Database Systems and Queries #Graph Theory and Algorithms #Natural Language Processing Techniques #cs.CL #cs.LG
- The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text
2025/06/05 by Nikhil Kandpal, Brian Lester, Kandpal, Nikhil +51 · 20 voices · 9 citations
Computer Science · Medicine · #Topic Modeling #Hate Speech and Cyberbullying Detection #Artificial Intelligence in Healthcare and Education
- Transformers Can Do Arithmetic with the Right Embeddings
2024/05/27 by Sean McLeish, McLeish, Sean, Arpit Bansal +20 · 5 voices · 25 citations
Computer Science · #Computability, Logic, AI Algorithms #cs.AI #cs.LG
- Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust
2023/05/31 by Yuxin Wen, Wen, Yuxin, John Kirchenbauer +5 · 2 voices · 43 citations
Computer Science · #Advanced Steganography and Watermarking Techniques #Digital Media Forensic Detection #Generative Adversarial Networks and Image Synthesis #cs.CR #cs.CV #cs.LG
- Baseline Defenses for Adversarial Attacks Against Aligned Language Models
2023/09/01 by Neel Jain, Jain, Neel, Avi Schwarzschild +17 · 147 citations
Computer Science · #Adversarial Robustness in Machine Learning #Topic Modeling #Natural Language Processing Techniques
- Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery
2023/02/07 by Yuxin Wen, Wen, Yuxin, Neel Jain +9 · 1 voice · 56 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Computational Physics and Python Applications #Gene expression and cancer classification #cs.CL #cs.LG
- On the Reliability of Watermarks for Large Language Models
2023/06/07 by John Kirchenbauer, Kirchenbauer, John, Jonas Geiping +17 · 41 citations
Computer Science · #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- NEFTune: Noisy Embeddings Improve Instruction Finetuning
2023/10/09 by Neel Jain, Jain, Neel, Ping-yeh Chiang +23 · 18 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- GenQA: Generating Millions of Instructions from a Handful of Prompts
2024/06/14 by Jiuhai Chen, Chen, Jiuhai, Rifaa Qadri +11 · 13 citations
Social Sciences · Computer Science · #Educational Assessment and Pedagogy #Intelligent Tutoring Systems and Adaptive Learning #Educational Technology and Assessment
- Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative LLMs
2024/06/14 by Abhimanyu Hans, Yuxin Wen, Hans, Abhimanyu +19 · 11 citations
Computer Science · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling #Wikis in Education and Collaboration
- Exploiting Sparsity for Long Context Inference: Million Token Contexts on Commodity GPUs
2025/02/10 by Ryan Synk, Monte Hoover, Synk, Ryan +14 · 1 voice · 3 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Image Retrieval and Classification Techniques #Advanced Neural Network Applications
- Gemstones: A Model Suite for Multi-Faceted Scaling Laws
2025/02/07 by Sean McLeish, McLeish, Sean, John Kirchenbauer +12 · 7 citations
Earth and Planetary Sciences · #Mineralogy and Gemology Studies #Geology and Paleoclimatology Research #Paleontology and Stratigraphy of Fossils
- Bring Your Own Data! Self-Supervised Evaluation for Large Language Models
2023/06/23 by Neel Jain, Khalid Saifullah, Jain, Neel +15 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Democratizing AI: Open-source Scalable LLM Training on GPU-based Supercomputers
2025/02/12 by Singh, Siddharth, Singhania, Prajwal, Ranjan, Aditya +9 · 5 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- LMD3: Language Model Data Density Dependence
2024/05/10 by Kirchenbauer, John, Honke, Garrett, Somepalli, Gowthami +5 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence
2025/11/10 by McLeish, Sean, Li, Ang, Kirchenbauer, John +7 · 3 citations
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- OPTune: Efficient Online Preference Tuning
2024/06/11 by Li-chang Chen, Jiuhai Chen, Chen, Lichang +15 · 1 citation
Computer Science · Social Sciences · #Algorithms and Data Compression #Computation and Language (cs.CL) #Data Management and Algorithms #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia Communication and Technology