Dirk Hovy

1. Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models
   2024/02/26 by Paul Röttger, Röttger, Paul, Valentin Hofmann +11 · 2 voices · 38 citations
   Computer Science · #Natural Language Processing Techniques #Topic Modeling
2. Large Language Model Hacking: Quantifying the Hidden Risks of Using LLMs for Text Annotation
   2025/09/10 by Joachim Baumann, Paul Röttger, Baumann, Joachim +11 · 7 voices · 24 citations
   Computer Science · Medicine · Social Sciences · #Artificial Intelligence in Healthcare and Education #Computational and Text Analysis Methods #Topic Modeling #cs.AI #cs.CL #cs.LG
3. Pre-training is a Hot Topic: Contextualized Document Embeddings Improve\n Topic Coherence
   2020/04/08 by Federico Bianchi, Silvia Terragni, Bianchi, Federico +3 · 20 citations
   Computer Science · Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
4. "My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models
   2024/02/22 by Xinpeng Wang, Bolei Ma, Wang, Xinpeng +13 · 13 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Intelligent Tutoring Systems and Adaptive Learning
5. Entropy-based Attention Regularization Frees Unintended Bias Mitigation\n from Lists
   2022/03/17 by Giuseppe Attanasio, Attanasio, Giuseppe, Debora Nozza +5 · 7 citations
   Computer Science · #Hate Speech and Cyberbullying Detection #Adversarial Robustness in Machine Learning
6. What the [MASK]? Making Sense of Language-Specific BERT Models
   2020/03/05 by Debora Nozza, Federico Bianchi, Nozza, Debora +3 · 1 voice · 6 citations
   Computer Science · #Explainable Artificial Intelligence (XAI) #Natural Language Processing Techniques #Topic Modeling #cs.CL
7. Angry Men, Sad Women: Large Language Models Reflect Gendered Stereotypes in Emotion Attribution
   2024/03/05 by Flor Miriam Plaza-del-Arco, Amanda Cercas Curry, Plaza-del-Arco, Flor Miriam +7 · 8 citations
   Psychology · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Gender, Feminism, and Media #Populism, Right-Wing Movements #Resilience and Mental Health
8. Classist Tools: Social Class Correlates with Performance in NLP
   2024/03/07 by Amanda Cercas Curry, Curry, Amanda Cercas, Giuseppe Attanasio +5 · 3 voices · 4 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Online Learning and Analytics
9. Know Your Audience: Do LLMs Adapt to Different Age and Education Levels?
   2023/12/04 by Donya Rooein, Rooein, Donya, Amanda Cercas Curry +3 · 1 voice · 6 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.AI #cs.CL
10. IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistance
    2025/02/12 by Paul Röttger, Musashi Hinck, Röttger, Paul +11 · 2 voices · 7 citations
    #cs.CL
11. Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directions
    2024/03/02 by Flor Miriam Plaza-del-Arco, Alba Curry, Plaza-del-Arco, Flor Miriam +5 · 6 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Sentiment Analysis and Opinion Mining #Topic Modeling
12. Anticipating Safety Issues in E2E Conversational AI: Framework and Tooling
    2021/07/07 by Emily Dinan, Gavin Abercrombie, Dinan, Emily +11 · 5 citations
    Computer Science · Social Sciences · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Topic Modeling
13. Divine LLaMAs: Bias, Stereotypes, Stigmatization, and Emotion Representation of Religion in Large Language Models
    2024/07/09 by Flor Miriam Plaza-del-Arco, Plaza-del-Arco, Flor Miriam, Amanda Cercas Curry +7 · 1 voice · 5 citations
    Arts and Humanities · #Media, Religion, Digital Communication #cs.CL #cs.CY
14. Beyond Flesch-Kincaid: Prompt-based Metrics Improve Difficulty Classification of Educational Texts
    2024/05/15 by Donya Rooein, Rooein, Donya, Paul Röttger +5 · 5 citations
    Computer Science · #Text Readability and Simplification #Natural Language Processing Techniques
15. Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps
    2024/02/28 by Giuseppe Attanasio, Attanasio, Giuseppe, Beatrice Savoldi +5 · 1 voice · 3 citations
    Computer Science · #cs.CL
16. MSTS: A Multimodal Safety Test Suite for Vision-Language Models
    2025/01/17 by Paul Röttger, Röttger, Paul, Giuseppe Attanasio +43 · 2 voices · 2 citations
    Computer Science · #Natural Language Processing Techniques #cs.CL
17. SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviors
    2025/10/20 by Tiancheng Hu, Joachim Baumann, Hu, Tiancheng +9 · 1 voice · 5 citations
    Computer Science · Social Sciences · #Computational and Text Analysis Methods #Multimodal Machine Learning Applications #Topic Modeling #cs.AI #cs.CL #cs.CY #cs.LG
18. What Can Natural Language Processing Do for Peer Review?
    2024/05/10 by Ilia Kuznetsov, Osama Mohammed Afzal, Kuznetsov, Ilia +45 · 5 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
19. Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP
    2023/05/02 by Anya Belz, Belz, Anya, Craig Thomson +81 · 1 voice
    Computer Science · #68 #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #cs.CL
20. Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages
    2022/10/20 by Paul Röttger, Röttger, Paul, Debora Nozza +5 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Internet Traffic Analysis and Secure E-voting
21. Conversations as a Source for Teaching Scientific Concepts at Different Education Levels
    2024/04/16 by Donya Rooein, Rooein, Donya, Dirk Hovy +1 · 1 voice · 1 citation
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
22. Stop Automating Peer Review Without Rigorous Evaluation
    2026/05/04 by Joachim Baumann, Jiaxin Pei, Sanmi Koyejo +1 · 2 voices · 2 citations
    #cs.AI
23. Compromesso! Italian Many-Shot Jailbreaks Undermine the Safety of Large Language Models
    2024/08/08 by Fabio Pernisi, Dirk Hovy, Pernisi, Fabio +3 · 1 citation
    Social Sciences · #Computation and Language (cs.CL) #European Criminal Justice and Data Protection #FOS: Computer and information sciences
24. Narratives at Conflict: Computational Analysis of News Framing in Multilingual Disinformation Campaigns
    2024/08/24 by Antonina Sinelnik, Sinelnik, Antonina, Dirk Hovy +1 · 1 citation
    Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Misinformation and Its Impacts
25. Biased Tales: Cultural and Topic Bias in Generating Children's Stories
    2025/09/09 by Donya Rooein, Rooein, Donya, Vilém Zouhar +5 · 2 citations
    Psychology · #Child and Animal Learning Development #Computation and Language (cs.CL) #Evolutionary Psychology and Human Behavior #FOS: Computer and information sciences #Social Robot Interaction and HRI