John Kirchenbauer
- A Watermark for Large Language Models
2023/01/24 by John Kirchenbauer, Jonas Geiping, Kirchenbauer, John +9 · 9 voices · 117 citations
Computer Science · #Adversarial Robustness in Machine Learning #Hate Speech and Cyberbullying Detection #Topic Modeling #cs.CL #cs.CR #cs.LG
- Latent Iteration as Renormalization: Inference-Time Recurrence in a Depth-Recurrent Transformer Flows Attention Geometry Toward the SYK Conformal Fixed Point
2025/02/07 by Jonas Geiping, Geiping, Jonas, Sean McLeish +16 · 25 voices · 92 citations
Computer Science · #Advanced Database Systems and Queries #Graph Theory and Algorithms #Natural Language Processing Techniques #cs.CL #cs.LG
- The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text
2025/06/05 by Nikhil Kandpal, Brian Lester, Kandpal, Nikhil +51 · 20 voices · 9 citations
Computer Science · Medicine · #Topic Modeling #Hate Speech and Cyberbullying Detection #Artificial Intelligence in Healthcare and Education
- Transformers Can Do Arithmetic with the Right Embeddings
2024/05/27 by Sean McLeish, McLeish, Sean, Arpit Bansal +20 · 5 voices · 20 citations
Computer Science · #Computability, Logic, AI Algorithms #cs.AI #cs.LG
- Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust
2023/05/31 by Yuxin Wen, Wen, Yuxin, John Kirchenbauer +5 · 2 voices · 33 citations
Computer Science · #Advanced Steganography and Watermarking Techniques #Digital Media Forensic Detection #Generative Adversarial Networks and Image Synthesis #cs.CR #cs.CV #cs.LG
- Baseline Defenses for Adversarial Attacks Against Aligned Language Models
2023/09/01 by Neel Jain, Avi Schwarzschild, Jain, Neel +17 · 107 citations
Computer Science · #Adversarial Robustness in Machine Learning #Topic Modeling #Natural Language Processing Techniques
- Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery
2023/02/07 by Yuxin Wen, Wen, Yuxin, Neel Jain +9 · 1 voice · 41 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Computational Physics and Python Applications #Gene expression and cancer classification #cs.CL #cs.LG
- NEFTune: Noisy Embeddings Improve Instruction Finetuning
2023/10/09 by Neel Jain, Ping-yeh Chiang, Jain, Neel +23 · 13 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative LLMs
2024/06/14 by Abhimanyu Hans, Hans, Abhimanyu, Yuxin Wen +19 · 8 citations
Computer Science · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling #Wikis in Education and Collaboration
- GenQA: Generating Millions of Instructions from a Handful of Prompts
2024/06/14 by Jiuhai Chen, Chen, Jiuhai, Rifaa Qadri +11 · 6 citations
Social Sciences · Computer Science · #Educational Assessment and Pedagogy #Intelligent Tutoring Systems and Adaptive Learning #Educational Technology and Assessment
- Exploiting Sparsity for Long Context Inference: Million Token Contexts on Commodity GPUs
2025/02/10 by Ryan Synk, Synk, Ryan, Monte Hoover +14 · 1 voice · 2 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Image Retrieval and Classification Techniques #Advanced Neural Network Applications
- Gemstones: A Model Suite for Multi-Faceted Scaling Laws
2025/02/07 by Sean McLeish, McLeish, Sean, John Kirchenbauer +12 · 7 citations
Earth and Planetary Sciences · #Mineralogy and Gemology Studies #Geology and Paleoclimatology Research #Paleontology and Stratigraphy of Fossils
- OPTune: Efficient Online Preference Tuning
2024/06/11 by Li-chang Chen, Chen, Lichang, Jiuhai Chen +15 · 1 citation
Computer Science · Social Sciences · #Algorithms and Data Compression #Computation and Language (cs.CL) #Data Management and Algorithms #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia Communication and Technology