Tushar Khot
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
2018/03/14 by Peter E. Clark, Clark, Peter, Isaac Cowhey +11 · 730 citations
Computer Science · #Topic Modeling #Logic, Reasoning, and Knowledge #Natural Language Processing Techniques
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
2022/06/09 by Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448 · 3 voices · 138 citations
#cs.CL #cs.AI #cs.CY #cs.LG #stat.ML
- Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering
2018/09/08 by Todor Mihaylov, Mihaylov, Todor, Peter Clark +6 · 279 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Information Retrieval and Search Behavior
- MuSiQue: Multihop Questions via Single-hop Question Composition
2021/08/02 by Harsh Trivedi, Trivedi, Harsh, Niranjan Balasubramanian +5 · 219 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions
2022/12/20 by Harsh Trivedi, Niranjan Balasubramanian, Trivedi, Harsh +5 · 171 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies
2021/01/06 by Mor Geva, Daniel Khashabi, Geva, Mor +9 · 97 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Decomposed Prompting: A Modular Approach for Solving Complex Tasks
2022/10/05 by Tushar Khot, Khot, Tushar, Harsh Trivedi +11 · 83 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- OLMo: Accelerating the Science of Language Models
2024/02/01 by Dirk Groeneveld, Iz Beltagy, Groeneveld, Dirk +83 · 78 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- Complexity-Based Prompting for Multi-Step Reasoning
2022/10/03 by Yao Fu, Hao Peng, Fu, Yao +7 · 40 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
2024/07/26 by Harsh Trivedi, Trivedi, Harsh, Tushar Khot +15 · 45 citations
Social Sciences · Engineering · #Multimedia Communication and Technology #Smart Parking Systems Research
- ADaPT: As-Needed Decomposition and Planning with Language Models
2023/11/08 by Archiki Prasad, Prasad, Archiki, Alexander Koller +11 · 36 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources
2023/06/07 by Yizhong Wang, Wang, Yizhong, Hamish Ivison +19 · 31 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning and Data Classification
- Specializing Smaller Language Models towards Multi-Step Reasoning
2023/01/30 by Yao Fu, Fu, Yao, Hao Peng +7 · 28 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
- Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs
2023/11/08 by Shashank Gupta, Gupta, Shashank, Vaishnavi Shrivastava +11 · 34 citations
Psychology · Computer Science · Social Sciences · #Digital Mental Health Interventions #Persona Design and Applications #Ethics and Social Impacts of AI
- Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedback
2023/05/17 by Yao Fu, Hao Peng, Fu, Yao +5 · 20 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
- Think you have Solved Direct-Answer Question Answering? Try ARC-DA, the Direct-Answer AI2 Reasoning Challenge
2021/02/05 by Sumithra Bhakthavatsalam, Daniel Khashabi, Bhakthavatsalam, Sumithra +16 · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- DiscoveryBench: Towards Data-Driven Discovery with Large Language Models
2024/07/01 by Bodhisattwa Prasad Majumder, Majumder, Bodhisattwa Prasad, Harshit Surana +17 · 16 citations
Computer Science · #Semantic Web and Ontologies #Natural Language Processing Techniques #Advanced Database Systems and Queries
- DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents
2024/06/10 by Peter Jansen, Marc-Alexandre Côté, Jansen, Peter +13 · 11 citations
Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Scientific Computing and Data Management #Semantic Web and Ontologies
- SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories
2024/09/11 by Ben Bogin, Bogin, Ben, Kejuan Yang +13 · 9 citations
Decision Sciences · Computer Science · #Scientific Computing and Data Management #Semantic Web and Ontologies
- Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance
2023/05/26 by Yao Fu, Litu Ou, Fu, Yao +9 · 5 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Explainable Artificial Intelligence (XAI)
- Repurposing Entailment for Multi-Hop Question Answering Tasks
2019/04/20 by Harsh Trivedi, Hee Young Kwon, Trivedi, Harsh +7 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- IIRC: A Dataset of Incomplete Information Reading Comprehension\n Questions
2020/11/13 by James F. Ferguson, Ferguson, James, Matt Gardner +8 · 2 citations
Computer Science · #Topic Modeling #Text Readability and Simplification #Natural Language Processing Techniques
- Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts
2021/12/15 by Daniel Khashabi, Shane Lyu, Khashabi, Daniel +19 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- From 'F' to 'A' on the N.Y. Regents Science Exams: An Overview of the Aristo Project
2019/09/04 by Peter Clark, Clark, Peter, Oren Etzioni +26 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Software Engineering Research
- Text Modular Networks: Learning to Decompose Tasks in the Language of\n Existing Models
2020/09/01 by Tushar Khot, Daniel Khashabi, Khot, Tushar +7 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks
2022/10/18 by Nikil Roashan Selvam, Sunipa Dev, Selvam, Nikil Roashan +7 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Machine Learning (cs.LG) #Social and Information Networks (cs.SI)
- On the Possibilities and Limitations of Multi-hop Reasoning Under Linguistic Imperfections
2019/01/08 by Daniel Khashabi, Khashabi, Daniel, Erfan Sadeqi Azer +7 · 1 citation
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Logic, Reasoning, and Knowledge
- Leveraging In-Context Learning for Language Model Agents
2025/06/16 by Shivanshu Gupta, Gupta, Shivanshu, Sameer Singh +7 · 2 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques