Barbara Plank
- LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks
2024/06/26 by Anna Bavaresco, Bavaresco, Anna, Raffaella Bernardi +37 · 5 voices · 66 citations
#cs.CL
- The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
2022/11/04 by Barbara Plank, Plank, Barbara · 13 citations
Computer Science · #Machine Learning and Data Classification #Statistical and Computational Modeling
- VariErr NLI: Separating Annotation Error from Human Label Variation
2024/03/04 by Leon Weber, Weber-Genzel, Leon, Siyao Peng +5 · 19 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning and Data Classification
- "My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models
2024/02/22 by Xinpeng Wang, Wang, Xinpeng, Bolei Ma +13 · 16 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Intelligent Tutoring Systems and Adaptive Learning
- Uncertainty in Natural Language Generation: From Theory to Applications
2023/07/28 by Joris Baan, Nico Daheim, Baan, Joris +17 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability
2023/05/19 by Mario Giulianelli, Joris Baan, Giulianelli, Mario +7 · 12 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- SemEval-2023 Task 11: Learning With Disagreements (LeWiDi)
2023/04/28 by Elisa Leonardelli, Alexandra Uma, Leonardelli, Elisa +15 · 11 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning\n in NLP
2020/05/29 by Rob van der Goot, van der Goot, Rob, Ahmet Üstün +7 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Surgical, Cheap, and Flexible: Mitigating False Refusal in Language Models via Single Vector Ablation
2024/10/04 by Xinpeng Wang, Chengzhi Hu, Wang, Xinpeng +5 · 2 voices · 10 citations
#cs.CL
- Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training
2023/10/25 by Max Müller-Eberstein, Rob van der Goot, Müller-Eberstein, Max +5 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges
2025/02/17 by Bolei Ma, Yuting Li, Ma, Bolei +17 · 2 voices · 11 citations
Computer Science · #Natural Language Processing Techniques
- LoHoRavens: A Long-Horizon Language-Conditioned Benchmark for Robotic Tabletop Manipulation
2023/10/18 by Shengqiang Zhang, Philipp Wicke, Zhang, Shengqiang +13 · 7 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- SkillSpan: Hard and Soft Skill Extraction from English Job Postings
2022/04/27 by Mike Zhang, Zhang, Mike, Kristian Nørgaard Jensen +5 · 5 citations
Computer Science · #Advanced Graph Neural Networks #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Keystroke dynamics as signal for shallow syntactic parsing
2016/10/11 by Barbara Plank, Plank, Barbara · 3 citations
Computer Science · Neuroscience · #Text Readability and Simplification #Neurobiology of Language and Bilingualism #Natural Language Processing Techniques
- The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models
2024/06/16 by Bolei Ma, Ma, Bolei, Xinpeng Wang +11 · 7 citations
Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences
- What Do Dialect Speakers Want? A Survey of Attitudes Towards Language Technology for German Dialects
2024/02/19 by Verena Blaschke, Blaschke, Verena, Christoph Purschke +5 · 5 citations
Arts and Humanities · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Linguistic Education and Pedagogy #Linguistic research and analysis
- FinerCut: Finer-grained Interpretable Layer Pruning for Large Language Models
2024/05/28 by Yang Zhang, Zhang, Yang, Yawei Li +13 · 5 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Using natural language processing to analyse text data in behavioural science
2025/01/02 by Stefan Feuerriegel, Abdurahman Maarouf, Dominik Bär +14 · 1 voice · 8 citations
Computer Science · Psychology · #Advanced Text Analysis Techniques #Mental Health via Writing #Sentiment Analysis and Opinion Mining
- Psycholinguistics meets Continual Learning: Measuring Catastrophic\n Forgetting in Visual Question Answering
2019/06/10 by Claudio Greco, Greco, Claudio, Barbara Plank +5 · 2 citations
Arts and Humanities · Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Subtitles and Audiovisual Media
- From extraction to end‐uses and waste management: Modeling economy‐wide material cycles and stock dynamics around the world
2024/11/12 by Dominik Wiedenhofer, Jan Streeck, Hanspeter Wieland +7 · 2 voices · 5 citations
Business, Management and Accounting · Engineering · Environmental Science · #Environmental Impact and Sustainability #Sustainable Industrial Ecology #Sustainable Supply Chain Management
- Comparing Inferential Strategies of Humans and Large Language Models in Deductive Reasoning
2024/02/20 by Philipp Mondorf, Mondorf, Philipp, Barbara Plank +1 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning
- De-identification of Privacy-related Entities in Job Postings
2021/05/24 by Kristian Nørgaard Jensen, Mike Zhang, Jensen, Kristian Nørgaard +3 · 2 citations
Decision Sciences · Computer Science · #Data Quality and Management #Topic Modeling #Authorship Attribution and Profiling
- Probing for Labeled Dependency Trees
2022/03/24 by Max Müller-Eberstein, Müller-Eberstein, Max, Rob van der Goot +3 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- Deep Learning-based Computational Job Market Analysis: A Survey on Skill Extraction and Classification from Job Postings
2024/02/08 by Elena Senger, Mike Zhang, Senger, Elena +5 · 4 citations
Business, Management and Accounting · #AI and HR Technologies
- The Validation Gap: A Mechanistic Analysis of How Language Models Compute Arithmetic but Fail to Validate It
2025/02/17 by Leonardo Bertolazzi, Bertolazzi, Leonardo, Philipp Mondorf +5 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- Probing LLMs for Multilingual Discourse Generalization Through a Unified Label Set
2025/03/13 by Florian Eichin, Eichin, Florian, Yang Janet Liu +5 · 2 voices · 3 citations
#cs.CL
- What's the Difference? Supporting Users in Identifying the Effects of Prompt and Model Changes Through Token Patterns
2025/04/22 by Michael A. Hedderich, Anyi Wang, Hedderich, Michael A. +9 · 3 voices · 3 citations
Computer Science · #Software Engineering Research #Digital and Cyber Forensics #Model-Driven Software Engineering Techniques
- MultiClimate: Multimodal Stance Detection on Climate Change Videos
2024/09/26 by Jiawen Wang, Wang, Jiawen, Longfei Zuo +5 · 3 citations
Social Sciences · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Public Relations and Crisis Communication
- Circuit Compositions: Exploring Modular Structures in Transformer-Based Language Models
2024/10/02 by Philipp Mondorf, Mondorf, Philipp, Sondre Wold +3 · 4 voices · 2 citations
#cs.LG #cs.CL
- Liar, Liar, Logical Mire: A Benchmark for Suppositional Reasoning in Large Language Models
2024/06/18 by Philipp Mondorf, Barbara Plank, Mondorf, Philipp +1 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Semantic Web and Ontologies
- Evaluating Pixel Language Models on Non-Standardized Languages
2024/12/12 by Alberto Muñoz-Ortiz, Verena Blaschke, Muñoz-Ortiz, Alberto +3 · 4 citations
Computer Science · #68T50 #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #Multimodal Machine Learning Applications
- Distant Supervision from Disparate Sources for Low-Resource\n Part-of-Speech Tagging
2018/08/29 by Barbara Plank, Plank, Barbara, Żeljko Agić +1 · 1 citation
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
- Interpreting Predictive Probabilities: Model Confidence or Human Label Variation?
2024/02/25 by Joris Baan, Baan, Joris, Raquel Fernández +5 · 2 citations
Computer Science · #Bayesian Modeling and Causal Inference #Computation and Language (cs.CL) #FOS: Computer and information sciences
- An Empirical Comparison of Generative Approaches for Product Attribute-Value Identification
2024/07/01 by Kassem Sabeh, Robert Litschko, Sabeh, Kassem +7 · 2 citations
Business, Management and Accounting · #Product Development and Customization
- Lost in Inference: Rediscovering the Role of Natural Language Inference for Large Language Models
2024/11/21 by Lovish Madaan, David Esiobu, Madaan, Lovish +7 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Experimental Standards for Deep Learning in Natural Language Processing Research
2022/04/13 by Dennis Ulmer, Elisa Bassignana, Ulmer, Dennis +12 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- From Dissonance to Insights: Dissecting Disagreements in Rationale Construction for Case Outcome Classification
2023/10/18 by Shanshan Xu, Santosh T.y.s.s, Xu, Shanshan +9 · 2 citations
Social Sciences · #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences
- CrossRE: A Cross-Domain Dataset for Relation Extraction
2022/10/17 by Elisa Bassignana, Bassignana, Elisa, Barbara Plank +1 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- Do LLMs Give Psychometrically Plausible Responses in Educational Assessments?
2025/06/11 by Andreas Säuberli, Diego Frassinelli, Säuberli, Andreas +3 · 3 citations
Computer Science · Decision Sciences · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Psychometric Methodologies and Testing #Student Assessment and Feedback
- Multi-CrossRE A Multi-Lingual Multi-Domain Dataset for Relation Extraction
2023/05/18 by Elisa Bassignana, Bassignana, Elisa, Filip Ginter +7 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Boosting Zero-shot Cross-lingual Retrieval by Training on Artificially Code-Switched Data
2023/05/09 by Robert Litschko, Litschko, Robert, Ekaterina Artemova +3 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications #Topic Modeling
- Through the Lens of Split Vote: Exploring Disagreement, Difficulty and Calibration in Legal Case Outcome Classification
2024/02/11 by Shanshan Xu, T. Y. S. S Santosh, Xu, Shanshan +7 · 2 citations
Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Judicial and Constitutional Studies
- How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives
2023/05/24 by Xinpeng Wang, Wang, Xinpeng, Leonie Weissweiler +5 · 1 citation
Computer Science · Engineering · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG)
- Industry Transformations for High Service Provisioning with Lower Energy and Material Demand: A Review of Models and Scenarios
2024/09/16 by Dominik Wiedenhofer, Jan Streeck, Frauke Wiese +26 · 1 voice · 1 citation
Economics, Econometrics and Finance · Engineering · #Electric Vehicles and Infrastructure #Innovation Policy and R&D
- Better Aligned with Survey Respondents or Training Data? Unveiling Political Leanings of LLMs on U.S. Supreme Court Cases
2025/02/25 by Shanshan Xu, T. Y. S. S Santosh, Xu, Shanshan +9 · 1 voice · 2 citations
#cs.CL
- RAcQUEt: Unveiling the Dangers of Overlooked Referential Ambiguity in Visual LLMs
2024/12/18 by Alberto Testoni, Barbara Plank, Testoni, Alberto +3 · 2 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Digital Imaging for Blood Diseases #Digital Media Forensic Detection
- MaiBaam: A Multi-Dialectal Bavarian Universal Dependency Treebank
2024/03/15 by Verena Blaschke, Blaschke, Verena, Barbara Kovačić +7 · 1 citation
Arts and Humanities · Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Linguistic Education and Pedagogy #Linguistic research and analysis #Natural Language Processing Techniques
- Languages in Whisper-Style Speech Encoders Align Both Phonetically and Semantically
2025/05/26 by Ryan Soh-Eun Shim, Domenico De Cristofaro, Shim, Ryan Soh-Eun +8 · 1 voice · 2 citations
Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Speech and dialogue systems #cs.CL
- Establishing Trustworthiness: Rethinking Tasks and Model Evaluation
2023/10/09 by Robert Litschko, Litschko, Robert, Max Müller-Eberstein +7 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Exploring Large Language Models for Product Attribute Value Identification
2024/09/19 by Kassem Sabeh, Sabeh, Kassem, Mouna Kacimi +7 · 1 citation
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- Cross-Dialect Information Retrieval: Information Access in Low-Resource and High-Variance Languages
2024/12/17 by Robert Litschko, Litschko, Robert, Oliver Kraus +5 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Natural Language Processing Techniques
- Reason to Rote: Rethinking Memorization in Reasoning
2025/07/07 by Yupei Du, Y. Le Du, Philipp Mondorf +10 · 1 voice · 2 citations
Computer Science · #Multi-Agent Systems and Negotiation #cs.CL #cs.LG
- Mind the Uncertainty in Human Disagreement: Evaluating Discrepancies between Model Predictions and Human Responses in VQA
2024/09/17 by Jian Lan, Diego Frassinelli, Lan, Jian +3 · 1 citation
Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Bayesian Modeling and Causal Inference #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Risk and Safety Analysis
- M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis
2025/02/17 by Chengyan Wu, Wu, Chengyan, Bolei Ma +17 · 1 citation
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Sentiment Analysis and Opinion Mining
- A Rose by Any Other Name: LLM-Generated Explanations Are Good Proxies for Human Explanations to Collect Label Distributions on NLI
2024/12/18 by Beiduo Chen, Siyao Peng, Chen, Beiduo +5 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Statistical and Computational Modeling #Topic Modeling