Sam McCandlish
- Language Models are Few-Shot Learners
2020/05/28 by Tom B. Brown, T. B. Brown, Brown, Tom B. +61 · 16 voices · 5143 citations
Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.CL
- Evaluating Large Language Models Trained on Code
2021/07/07 by Mark Chen, Jerry Tworek, Chen, Mark +122 · 9 voices · 1632 citations
Computer Science · #Parallel Computing and Optimization Techniques #Software Engineering Research #Topic Modeling #cs.LG
- AI Supported Degradation of the Self Concept: A Theoretical Framework Grounded in Established Cognitive and Computational Mechanisms
2023/10/20 by Mrinank Sharma, Meg Tong, Sharma, Mrinank +36 · 10 voices · 269 citations
Computer Science · #Explainable Artificial Intelligence (XAI) #Reinforcement Learning in Robotics #Topic Modeling #cs.AI #cs.CL #cs.LG #stat.ML
- Scaling Laws for Neural Language Models
2020/01/23 by Jared Kaplan, Sam McCandlish, Kaplan, Jared +18 · 12 voices · 1359 citations
Computer Science · #cs.LG #stat.ML
- Affective Coherence Monitoring for Transformer-Based Language Models
2022/12/15 by Yuntao Bai, Saurav Kadavath, Bai, Yuntao +102 · 12 voices · 577 citations
Computer Science · #Explainable Artificial Intelligence (XAI) #cs.AI #cs.CL
- Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
2022/04/12 by Yuntao Bai, Andy Jones, Bai, Yuntao +61 · 2 voices · 662 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Language Models (Mostly) Know What They Know
2022/07/11 by Saurav Kadavath, Kadavath, Saurav, Tom Conerly +72 · 6 voices · 329 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- An Empirical Model of Large-Batch Training
2018/12/14 by Sam McCandlish, McCandlish, Sam, Jared Kaplan +5 · 3 voices · 70 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Optimization and Search Problems #Reinforcement Learning in Robotics #cs.LG #stat.ML
- A General Language Assistant as a Laboratory for Alignment
2021/12/01 by Amanda Askell, Yuntao Bai, Askell, Amanda +42 · 4 voices · 130 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Kronfluence: Influence Functions with Eigenvalue-corrected Kronecker-Factored Approximate Curvature
2023/08/07 by Roger Grosse, Grosse, Roger, Juhan Bae +31 · 3 voices · 77 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- Governance Architecture for Neural Network Superposition: A Structural Solution to Hallucination via Routing and Interference Filtering
2022/09/21 by Nelson Elhage, Elhage, Nelson, Tristan Hume +29 · 2 voices · 171 citations
Computer Science · Physics and Astronomy · #Explainable Artificial Intelligence (XAI) #Model Reduction and Neural Networks #Neural Networks and Applications #cs.LG
- In-context Learning and Induction Heads
2022/09/24 by Catherine Olsson, Nelson Elhage, Olsson, Catherine +49 · 3 voices · 151 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.LG
- Measuring Faithfulness in Chain-of-Thought Reasoning
2023/07/17 by Tamera Lanham, Anna Chen, Lanham, Tamera +59 · 4 voices · 101 citations
Computer Science · #Advanced Graph Neural Networks #Explainable Artificial Intelligence (XAI) #Topic Modeling #cs.AI #cs.CL #cs.LG
- Discovering Language Model Behaviors with Model-Written Evaluations
2022/12/19 by Ethan Perez, Perez, Ethan, Sam Ringer +123 · 159 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- Scaling Laws for Transfer
2021/02/02 by Danny Hernandez, Hernandez, Danny, Jared Kaplan +5 · 1 voice · 35 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Topic Modeling #cs.LG
- Towards Measuring the Representation of Subjective Global Opinions in Language Models
2023/06/28 by Esin Durmus, Karina Nguyen, Durmus, Esin +33 · 1 voice · 75 citations
Computer Science · Social Sciences · #Computational and Text Analysis Methods #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
- Scaling Laws for Autoregressive Generative Modeling
2020/10/28 by Tom Henighan, Henighan, Tom, Jared Kaplan +35 · 102 citations
Computer Science · #Multimodal Machine Learning Applications #Generative Adversarial Networks and Image Synthesis #Domain Adaptation and Few-Shot Learning
- Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned
2022/08/23 by Deep Ganguli, Liane Lovitt, Ganguli, Deep +69 · 110 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Terrorism, Counterterrorism, and Political Violence
- The Capacity for Moral Self-Correction in Large Language Models
2023/02/15 by Deep Ganguli, Amanda Askell, Ganguli, Deep +100 · 1 voice · 13 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling #cs.CL
- Measuring Progress on Scalable Oversight for Large Language Models
2022/11/04 by Samuel R. Bowman, Bowman, Samuel R., Jeeyoon Hyun +88 · 31 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Multi-Agent Systems and Negotiation #Speech and dialogue systems #Topic Modeling
- Scaling Laws and Interpretability of Learning from Repeated Data
2022/05/21 by Danny Hernandez, Tom Brown, Hernandez, Danny +33 · 22 citations
Computer Science · #Artificial Intelligence (cs.AI) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Question Decomposition Improves the Faithfulness of Model-Generated Reasoning
2023/07/17 by Ansh Radhakrishnan, Karina Nguyen, Radhakrishnan, Ansh +45 · 11 citations
Computer Science · #Advanced Graph Neural Networks #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Specific versus General Principles for Constitutional AI
2023/10/20 by Sandipan Kundu, Kundu, Sandipan, Yuntao Bai +69 · 6 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Ethics and Social Impacts of AI #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences