vix.ing · top · new · best · stats · spec

Hovy, Dirk

  1. Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models
    2024/02/26 by Paul Röttger, Valentin Hofmann, Röttger, Paul +11 · 2 voices · 46 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling
  2. XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models
    2023/08/02 by Röttger, Paul, Kirk, Hannah Rose, Vidgen, Bertie +3 · 89 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  3. Large Language Model Hacking: Quantifying the Hidden Risks of Using LLMs for Text Annotation
    2025/09/10 by Joachim Baumann, Baumann, Joachim, Paul Röttger +11 · 7 voices · 24 citations
    Computer Science · Medicine · Social Sciences · #Artificial Intelligence in Healthcare and Education #Computational and Text Analysis Methods #Topic Modeling #cs.AI #cs.CL #cs.LG
  4. Pre-training is a Hot Topic: Contextualized Document Embeddings Improve\n Topic Coherence
    2020/04/08 by Federico Bianchi, Silvia Terragni, Bianchi, Federico +3 · 23 citations
    Computer Science · Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  5. Cross-lingual Contextualized Topic Models with Zero-shot Learning
    2020/04/16 by Bianchi, Federico, Terragni, Silvia, Hovy, Dirk +2 · 12 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  6. "My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models
    2024/02/22 by Xinpeng Wang, Bolei Ma, Wang, Xinpeng +13 · 16 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Intelligent Tutoring Systems and Adaptive Learning
  7. Entropy-based Attention Regularization Frees Unintended Bias Mitigation\n from Lists
    2022/03/17 by Giuseppe Attanasio, Debora Nozza, Attanasio, Giuseppe +5 · 9 citations
    Computer Science · #Hate Speech and Cyberbullying Detection #Adversarial Robustness in Machine Learning
  8. SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety
    2024/04/08 by Paul Röttger, Röttger, Paul, Fabio Pernisi +5 · 15 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
  9. What the [MASK]? Making Sense of Language-Specific BERT Models
    2020/03/05 by Debora Nozza, Nozza, Debora, Federico Bianchi +3 · 1 voice · 9 citations
    Computer Science · #Explainable Artificial Intelligence (XAI) #Natural Language Processing Techniques #Topic Modeling #cs.CL
  10. Consistency is Key: Disentangling Label Variation in Natural Language Processing with Intra-Annotator Agreement
    2023/01/25 by Gavin Abercrombie, Abercrombie, Gavin, Dinkar, Tanvi +3 · 6 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
  11. The AI Gap: How Socioeconomic Status Affects Language Technology Interactions
    2025/05/17 by Bassignana, Elisa, Curry, Amanda Cercas, Hovy, Dirk · 3 voices · 11 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  12. Angry Men, Sad Women: Large Language Models Reflect Gendered Stereotypes in Emotion Attribution
    2024/03/05 by Flor Miriam Plaza-del-Arco, Plaza-del-Arco, Flor Miriam, Amanda Cercas Curry +7 · 8 citations
    Psychology · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Gender, Feminism, and Media #Populism, Right-Wing Movements #Resilience and Mental Health
  13. Classist Tools: Social Class Correlates with Performance in NLP
    2024/03/07 by Amanda Cercas Curry, Giuseppe Attanasio, Curry, Amanda Cercas +5 · 3 voices · 4 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Online Learning and Analytics
  14. Know Your Audience: Do LLMs Adapt to Different Age and Education Levels?
    2023/12/04 by Donya Rooein, Rooein, Donya, Amanda Cercas Curry +3 · 1 voice · 6 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.AI #cs.CL
  15. Anticipating Safety Issues in E2E Conversational AI: Framework and Tooling
    2021/07/07 by Emily Dinan, Gavin Abercrombie, Dinan, Emily +11 · 7 citations
    Computer Science · Social Sciences · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Topic Modeling
  16. IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistance
    2025/02/12 by Paul Röttger, Röttger, Paul, Musashi Hinck +11 · 2 voices · 7 citations
    #cs.CL
  17. Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals' Subjective Text Perceptions
    2025/02/28 by Orlikowski, Matthias, Pei, Jiaxin, Röttger, Paul +3 · 14 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7
  18. Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps
    2024/02/28 by Giuseppe Attanasio, Beatrice Savoldi, Attanasio, Giuseppe +5 · 1 voice · 5 citations
    Computer Science · #cs.CL
  19. Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directions
    2024/03/02 by Flor Miriam Plaza-del-Arco, Plaza-del-Arco, Flor Miriam, Alba Curry +5 · 6 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Sentiment Analysis and Opinion Mining #Topic Modeling
  20. Divine LLaMAs: Bias, Stereotypes, Stigmatization, and Emotion Representation of Religion in Large Language Models
    2024/07/09 by Flor Miriam Plaza-del-Arco, Amanda Cercas Curry, Plaza-del-Arco, Flor Miriam +7 · 1 voice · 5 citations
    Arts and Humanities · #Media, Religion, Digital Communication #cs.CL #cs.CY
  21. Beyond Digital "Echo Chambers": The Role of Viewpoint Diversity in Political Discussion
    2022/12/18 by Hada, Rishav, Fard, Amir Ebrahimi, Shugars, Sarah +5 · 3 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  22. Beyond Flesch-Kincaid: Prompt-based Metrics Improve Difficulty Classification of Educational Texts
    2024/05/15 by Donya Rooein, Paul Röttger, Rooein, Donya +5 · 5 citations
    Computer Science · #Text Readability and Simplification #Natural Language Processing Techniques
  23. Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages
    2022/10/20 by Paul Röttger, Debora Nozza, Röttger, Paul +5 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Internet Traffic Analysis and Secure E-voting
  24. SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviors
    2025/10/20 by Tiancheng Hu, Joachim Baumann, Hu, Tiancheng +9 · 1 voice · 6 citations
    Computer Science · Social Sciences · #Computational and Text Analysis Methods #Multimodal Machine Learning Applications #Topic Modeling #cs.AI #cs.CL #cs.CY #cs.LG
  25. What about em? How Commercial Machine Translation Fails to Handle (Neo-)Pronouns
    2023/05/25 by Lauscher, Anne, Nozza, Debora, Crowley, Archie +2 · 2 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences
  26. MSTS: A Multimodal Safety Test Suite for Vision-Language Models
    2025/01/17 by Paul Röttger, Giuseppe Attanasio, Röttger, Paul +43 · 2 voices · 2 citations
    Computer Science · #Natural Language Processing Techniques #cs.CL
  27. Explaining Speech Classification Models via Word-Level Audio Segments and Paralinguistic Features
    2023/09/14 by Pastor, Eliana, Koudounas, Alkis, Attanasio, Giuseppe +2 · 2 citations
    #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
  28. What Can Natural Language Processing Do for Peer Review?
    2024/05/10 by Ilia Kuznetsov, Kuznetsov, Ilia, Osama Mohammed Afzal +45 · 5 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
  29. The Call for Socially Aware Language Technologies
    2024/05/03 by Yang, Diyi, Hovy, Dirk, Jurgens, David +1 · 2 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  30. Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP
    2023/05/02 by Anya Belz, Craig Thomson, Belz, Anya +81 · 1 voice
    Computer Science · #68 #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #cs.CL
  31. Welcome to the Modern World of Pronouns: Identity-Inclusive Natural Language Processing beyond Gender
    2022/02/24 by Anne Lauscher, Lauscher, Anne, Archie Crowley +3 · 1 citation
    Computer Science · #Hate Speech and Cyberbullying Detection
  32. Compromesso! Italian Many-Shot Jailbreaks Undermine the Safety of Large Language Models
    2024/08/08 by Fabio Pernisi, Pernisi, Fabio, Dirk Hovy +3 · 2 citations
    Social Sciences · #Computation and Language (cs.CL) #European Criminal Justice and Data Protection #FOS: Computer and information sciences
  33. SocioProbe: What, When, and Where Language Models Learn about Sociodemographics
    2022/11/08 by Lauscher, Anne, Bianchi, Federico, Bowman, Samuel +1 · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  34. Principled Personas: Defining and Measuring the Intended Effects of Persona Prompting on Task Performance
    2025/08/27 by de Araujo, Pedro Henrique Luz, Röttger, Paul, Hovy, Dirk +1 · 1 voice · 3 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  35. Conversations as a Source for Teaching Scientific Concepts at Different Education Levels
    2024/04/16 by Donya Rooein, Dirk Hovy, Rooein, Donya +1 · 1 voice · 1 citation
    Computer Science · Psychology · Social Sciences · #Computation and Language (cs.CL) #Education and Critical Thinking Development #Educational Strategies and Epistemologies #FOS: Computer and information sciences #Innovative Teaching and Learning Methods #cs.CL
  36. No for Some, Yes for Others: Persona Prompts and Other Sources of False Refusal in Language Models
    2025/09/09 by Plaza-del-Arco, Flor Miriam, Röttger, Paul, Scherrer, Nino +3 · 3 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  37. Towards Human-Level Text Coding with LLMs: The Case of Fatherhood Roles in Public Policy Documents
    2023/11/20 by Lupo, Lorenzo, Magnusson, Oscar, Hovy, Dirk +2 · 1 citation
    #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #I.2 #J.4
  38. DADIT: A Dataset for Demographic Classification of Italian Twitter Users and a Comparison of Prediction Methods
    2024/03/08 by Lorenzo Lupo, Lupo, Lorenzo, Mahyar Habibi +6 · 1 citation
    Computer Science · Social Sciences · #Authorship Attribution and Profiling #Computation and Language (cs.CL) #FOS: Computer and information sciences #Human Mobility and Location-Based Analysis #Misinformation and Its Impacts
  39. Narratives at Conflict: Computational Analysis of News Framing in Multilingual Disinformation Campaigns
    2024/08/24 by Antonina Sinelnik, Sinelnik, Antonina, Dirk Hovy +1 · 1 citation
    Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Misinformation and Its Impacts
  40. Biased Tales: Cultural and Topic Bias in Generating Children's Stories
    2025/09/09 by Donya Rooein, Rooein, Donya, Vilém Zouhar +5 · 2 citations
    Psychology · #Child and Animal Learning Development #Computation and Language (cs.CL) #Evolutionary Psychology and Human Behavior #FOS: Computer and information sciences #Social Robot Interaction and HRI
  41. Can Reasoning Help Large Language Models Capture Human Annotator Disagreement?
    2025/06/24 by Ni, Jingwei, Fan, Yu, Zouhar, Vilém +6 · 3 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences