Adina Williams
- Llama 2: Open Foundation and Fine-Tuned Chat Models
2023/07/18 by Hugo Touvron, Touvron, Hugo, Louis Martin +133 · 1548 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech and dialogue systems
- Adversarial NLI: A New Benchmark for Natural Language Understanding
2019/10/31 by Yixin Nie, Nie, Yixin, Adina Williams +9 · 1 voice · 72 citations
Computer Science · #Adversarial Robustness in Machine Learning #Multimodal Machine Learning Applications #Topic Modeling #cs.CL #cs.LG
- XNLI: Evaluating Cross-lingual Sentence Representations
2018/09/13 by Alexis Conneau, Guillaume Lample, Conneau, Alexis +11 · 90 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
2022/04/07 by Tristan Thrush, Ryan Jiang, Thrush, Tristan +11 · 67 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little
2021/04/14 by Koustuv Sinha, Sinha, Koustuv, Robin Jia +10 · 1 voice · 9 citations
Computer Science · #cs.CL #cs.LG
- The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models
2024/04/24 by Hannah Rose Kirk, Alexander Whitefield, Paul Röttger +9 · 3 voices · 23 citations
#cs.CL
- Improving Text-to-Image Consistency via Automatic Prompt Optimization
2024/03/26 by Oscar Mañas, Mañas, Oscar, Pietro Astolfi +15 · 23 citations
Computer Science · Social Sciences · #Handwritten Text Recognition Techniques #Image Retrieval and Classification Techniques #Multimedia Communication and Technology
- "I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Dataset
2022/05/18 by Eric M. Smith, Smith, Eric Michael, Melissa Hall +7 · 14 citations
Computer Science · #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Topic Modeling
- The Factorization Curse: Which Tokens You Predict Underlie the Reversal Curse and More
2024/06/07 by O. Kitouni, Ouail Kitouni, Niklas Nolte +11 · 3 voices · 5 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Social Sciences · #Conflict of Laws and Jurisdiction #Congenital limb and hand anomalies #Law, AI, and Intellectual Property #cs.AI #cs.CL #cs.LG
- Introducing v0.5 of the AI Safety Benchmark from MLCommons
2024/04/18 by Bertie Vidgen, Vidgen, Bertie, Adarsh Agrawal +202 · 2 voices · 11 citations
Computer Science · #Adversarial Robustness in Machine Learning
- SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological\n Inflection
2020/06/20 by Ekaterina Vylomova, Vylomova, Ekaterina, Jennifer Duffield White +52 · 6 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- BabyLM Turns 3: Call for papers for the 2025 BabyLM workshop
2025/02/15 by Lucas Charpentier, Charpentier, Lucas, Leshem Choshen +25 · 1 voice · 14 citations
#cs.CL
- DataPerf: Benchmarks for Data-Centric AI Development
2022/07/20 by Mark Mazumder, Mazumder, Mark, Colby Banbury +78 · 6 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
- Improving Model Evaluation using SMART Filtering of Benchmark Datasets
2024/10/26 by Vipul Gupta, Gupta, Vipul, Candace Ross +9 · 1 voice · 10 citations
Computer Science · #Neural Networks and Applications
- Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking
2021/05/21 by Zhiyi Ma, Kawin Ethayarajh, Ma, Zhiyi +15 · 5 citations
Computer Science · #Topic Modeling #Software Engineering Research #Explainable Artificial Intelligence (XAI)
- EmphAssess : a Prosodic Benchmark on Assessing Emphasis Transfer in Speech-to-Speech Models
2023/12/21 by Maureen de Seyssel, Antony D’Avirro, de Seyssel, Maureen +5 · 8 citations
Computer Science · #Speech and dialogue systems #Speech Recognition and Synthesis #Natural Language Processing Techniques
- Towards Geographic Inclusion in the Evaluation of Text-to-Image Models
2024/05/07 by Melissa Hall, Samuel J. Bell, Hall, Melissa +9 · 6 citations
Social Sciences · #Geographic Information Systems Studies
- [Call for Papers] The 2nd BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus
2024/04/09 by Leshem Choshen, Choshen, Leshem, Ryan Cotterell +17 · 5 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- ROBBIE: Robust Bias Evaluation of Large Generative Language Models
2023/11/29 by David Esiobu, Esiobu, David, Xiaoqing Tan +17 · 4 citations
Computer Science · Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Topic Modeling
- AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommons
2025/02/19 by Shaona Ghosh, Heather Frase, Ghosh, Shaona +200 · 1 voice · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #FOS: Computer and information sciences #cs.AI #cs.CY
- Verb Argument Structure Alternations in Word and Sentence Embeddings
2018/11/27 by Katharina Kann, Alex Warstadt, Kann, Katharina +5 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- IntPhys 2: Benchmarking Intuitive Physics Understanding In Complex Synthetic Environments
2025/06/11 by Florian Bordes, Bordes, Florian, Quentin Garrido +9 · 11 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Explainable Artificial Intelligence (XAI) #Multimodal Machine Learning Applications
- Transformers Can Navigate Mazes With Multi-Step Prediction
2024/12/06 by Niklas Nolte, Ouail Kitouni, Nolte, Niklas +7 · 1 voice · 4 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.LG
- The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks
2023/10/26 by Kaiser Sun, Adina Williams, Sun, Kaiser +3 · 2 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Topic Modeling #Biomedical Text Mining and Ontologies #Natural Language Processing Techniques
- What makes a good metric? Evaluating automatic metrics for text-to-image consistency
2024/12/18 by Candace Ross, Ross, Candace, Melissa Hall +5 · 4 citations
Computer Science · #Multimodal Machine Learning Applications #Image Retrieval and Classification Techniques
- Quantifying the Semantic Core of Gender Systems
2019/10/29 by Adina Williams, Williams, Adina, Ryan Cotterell +7 · 1 citation
Computer Science · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Gender Studies in Language #Linguistic Variation and Morphology #Natural Language Processing Techniques
- On the Relationships Between the Grammatical Genders of Inanimate Nouns\n and Their Co-Occurring Adjectives and Verbs
2020/05/03 by Adina Williams, Ryan Cotterell, Williams, Adina +7 · 1 citation
Computer Science · Social Sciences · #Authorship Attribution and Profiling #Computation and Language (cs.CL) #FOS: Computer and information sciences #Gender Studies in Language #Natural Language Processing Techniques
- ANLIzing the Adversarial Natural Language Inference Dataset
2020/10/24 by Adina Williams, Williams, Adina, Tristan Thrush +3 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Language model acceptability judgements are not always robust to context
2022/12/18 by Koustuv Sinha, Jon Gauthier, Sinha, Koustuv +11 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Explainable Artificial Intelligence (XAI)
- Do different prompting methods yield a common task representation in language models?
2025/05/17 by Guy Davidson, Todd M. Gureckis, Davidson, Guy +5 · 2 voices · 2 citations
#cs.CL #cs.LG
- The Causal Influence of Grammatical Gender on Distributional Semantics
2023/11/30 by Karolina Stańczak, Stańczak, Karolina, Kevin Du +7 · 1 citation
Arts and Humanities · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Gender Studies in Language #Language and cultural evolution #Language, Discourse, Communication Strategies
- Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks
2022/04/05 by Tristan Thrush, Thrush, Tristan, Kushal Tirumala +17 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Software Engineering Research
- Compositional learning of functions in humans and machines
2024/03/18 by Yanli Zhou, Brenden M. Lake, Zhou, Yanli +3 · 1 citation
Computer Science · Neuroscience · #Artificial Intelligence (cs.AI) #Cognitive Science and Education Research #FOS: Computer and information sciences #Fuzzy Logic and Control Systems #Human-Computer Interaction (cs.HC) #Machine Learning (cs.LG) #Neural Networks and Applications
- Chained Tuning Leads to Biased Forgetting
2024/12/21 by Megan Ung, Ung, Megan, Sun, Alicia +8 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
- Decomposed evaluations of geographic disparities in text-to-image models
2024/06/17 by Abhishek Sureddy, Dishant Padalia, Sureddy, Abhishek +15 · 1 citation
Social Sciences · #Geographic Information Systems Studies