Foutse Khomh
- GitHub Copilot AI pair programmer: Asset or Liability?
2022/06/30 by Arghavan Moradi Dakhel, Vahid Majdinasab, Dakhel, Arghavan Moradi +11 · 29 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE) #Software Engineering Research #Software Engineering Techniques and Practices #Software Testing and Debugging Techniques
- Bugs in Large Language Models Generated Code: An Empirical Study
2024/03/13 by Florian Tambon, Tambon, Florian, Arghavan Moradi Dakhel +9 · 18 citations
Computer Science · #Advanced Malware Detection Techniques #Software Testing and Debugging Techniques
- Introducing v0.5 of the AI Safety Benchmark from MLCommons
2024/04/18 by Bertie Vidgen, Vidgen, Bertie, Adarsh Agrawal +202 · 2 voices · 10 citations
Computer Science · #Adversarial Robustness in Machine Learning
- Silent Bugs in Deep Learning Frameworks: An Empirical Study of Keras and TensorFlow
2021/12/26 by Florian Tambon, Amin Nikanjam, Tambon, Florian +7 · 7 citations
Computer Science · #Adversarial Robustness in Machine Learning #Software Engineering Research #Machine Learning and Data Classification
- Assessing the Security of GitHub Copilot Generated Code -- A Targeted Replication Study
2023/11/18 by Vahid Majdinasab, Michael Joshua Bishop, Majdinasab, Vahid +9 · 10 citations
Computer Science · Decision Sciences · #Software Engineering Research #Scientific Computing and Data Management
- An Empirical Study on Bugs Inside PyTorch: A Replication Study
2023/07/25 by Sharon Chee Yin Ho, Ho, Sharon Chee Yin, Vahid Majdinasab +14 · 1 voice · 2 citations
Computer Science · #Advanced Malware Detection Techniques #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability #cs.AI #cs.SE
- Bugs in Machine Learning-based Systems: A Faultload Benchmark
2022/06/24 by Mohammad Mehdi Morovati, Morovati, Mohammad Mehdi, Amin Nikanjam +7 · 6 citations
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Radiation Effects in Electronics #Software Engineering (cs.SE)
- MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation
2025/03/13 by Weihao Xuan, Xuan, Weihao, Rui Yang +61 · 17 citations
Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #FOS: Computer and information sciences #Text Readability and Simplification #Topic Modeling
- Deep Learning Model Reuse in the HuggingFace Community: Challenges, Benefit and Trends
2024/01/24 by Mina Taraghi, Gianolli Dorcelus, Taraghi, Mina +7 · 5 citations
Decision Sciences · Computer Science · #Scientific Computing and Data Management #Software System Performance and Reliability #Model-Driven Software Engineering Techniques
- Threat Assessment in Machine Learning based Systems
2022/06/30 by Lionel Nganyewou Tidjon, Tidjon, Lionel Nganyewou, Foutse Khomh +1 · 3 citations
Computer Science · #Advanced Malware Detection Techniques #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering Research
- Chain of Targeted Verification Questions to Improve the Reliability of Code Generated by LLMs
2024/05/22 by Sylvain Kouemo Ngassom, Ngassom, Sylvain Kouemo, Arghavan Moradi Dakhel +5 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Software Engineering (cs.SE) #Software Reliability and Analysis Research #Software Testing and Debugging Techniques
- Faults in Deep Reinforcement Learning Programs: A Taxonomy and A Detection Approach
2021/01/01 by Amin Nikanjam, Mohammad Mehdi Morovati, Nikanjam, Amin +5 · 2 citations
Computer Science · #Advanced Software Engineering Methodologies #FOS: Computer and information sciences #Machine Learning (cs.LG) #Open Source Software Innovations #Software Engineering (cs.SE) #Software Engineering Research
- An Empirical Study of Self-Admitted Technical Debt in Machine Learning Software
2023/11/20 by Aaditya Bhatia, Foutse Khomh, Bhatia, Aaditya +5 · 3 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning and Data Classification #Software Engineering (cs.SE) #Software Engineering Research #Software Reliability and Analysis Research
- AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommons
2025/02/19 by Shaona Ghosh, Ghosh, Shaona, Heather Frase +200 · 1 voice · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #FOS: Computer and information sciences #cs.AI #cs.CY
- Studying Logging Practice in Machine Learning-based Applications
2023/01/10 by Patrick Loic Foalem, Foalem, Patrick Loic, Foutse Khomh +3 · 2 citations
Computer Science · #Cloud Computing and Resource Management #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Software Engineering (cs.SE) #Software System Performance and Reliability
- The Forgotten Role of Search Queries in IR-based Bug Localization: An\n Empirical Study
2021/08/11 by Mohammad Masudur Rahman, Foutse Khomh, Rahman, Mohammad Masudur +5 · 1 citation
Computer Science · #D.2 #D.2.5 #D.2.7 #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability #Software Testing and Debugging Techniques
- Testing Feedforward Neural Networks Training Programs
2022/04/01 by Houssem Ben Braiek, Foutse Khomh, Braiek, Houssem Ben +1 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Software Testing and Debugging Techniques #Software System Performance and Reliability
- Protecting Privacy in Software Logs: What Should Be Anonymized?
2024/09/17 by Roozbeh Aghili, Heng Li, Aghili, Roozbeh +3 · 3 citations
Decision Sciences · #Auction Theory and Applications
- A Comparison of Reinforcement Learning Frameworks for Software Testing Tasks
2022/08/25 by Paulina Stevia Nouwou Mindom, Amin Nikanjam, Mindom, Paulina Stevia Nouwou +3 · 1 citation
Computer Science · #Software Testing and Debugging Techniques #Software Engineering Research #Advanced Malware Detection Techniques
- On Assessing The Safety of Reinforcement Learning algorithms Using Formal Methods
2021/11/08 by Paulina Stevia Nouwou Mindom, Amin Nikanjam, Mindom, Paulina Stevia Nouwou +5 · 1 citation
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Formal Methods in Verification #Machine Learning (cs.LG) #Smart Grid Security and Resilience
- Bug Characteristics in Quantum Software Ecosystem
2022/04/25 by Mohamed Raed El aoun, Heng Li, aoun, Mohamed Raed El +5 · 1 citation
Computer Science · #Cloud Computing and Resource Management #FOS: Computer and information sciences #Quantum Computing Algorithms and Architecture #Quantum Information and Cryptography #Software Engineering (cs.SE)
- Fool SHAP with Stealthily Biased Sampling
2022/05/30 by Gabriel Laberge, Ulrich Aïvodji, Laberge, Gabriel +7 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare
- Quality issues in Machine Learning Software Systems
2022/08/18 by Pierre-Olivier Côté, Amin Nikanjam, Côté, Pierre-Olivier +5 · 1 citation
Computer Science · #Software Engineering Research
- Deploying Deep Reinforcement Learning Systems: A Taxonomy of Challenges
2023/08/23 by Ahmed Haj Yahmed, Yahmed, Ahmed Haj, Altaf Allah Abbassi +7 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Open Source Software Innovations #Software Engineering (cs.SE) #Software Engineering Research
- Characterizing and Classifying Developer Forum Posts with their Intentions
2023/12/21 by Xingfang Wu, Eric Laufer, Wu, Xingfang +9 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE) #Software Engineering Research #Topic Modeling #Web Data Mining and Analysis
- Performance Smells in ML and Non-ML Python Projects: A Comparative Study
2025/04/28 by François Belias, Belias, François, Léuson Da Silva +5 · 1 citation
Computer Science · #FOS: Computer and information sciences #Software Engineering (cs.SE) #Software Engineering Research #Software Engineering Techniques and Practices #Software System Performance and Reliability
- TaskEval: Assessing Difficulty of Code Generation Tasks for Large Language Models
2024/07/30 by Florian Tambon, Amin Nikanjam, Tambon, Florian +6 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Software Engineering (cs.SE) #Software Engineering Research #Software System Performance and Reliability #Topic Modeling
- Towards Optimizing SQL Generation via LLM Routing
2024/11/06 by Mohammadhossein Malekpour, Malekpour, Mohammadhossein, Shaheen, Nour +4 · 1 citation
Computer Science · #Advanced Database Systems and Queries #Databases (cs.DB) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Service-Oriented Architecture and Web Services
- Towards Understanding the Impact of Data Bugs on Deep Learning Models in Software Engineering
2024/11/19 by Mehil B Shah, Mohammad Masudur Rahman, Shah, Mehil B +3 · 2 citations
Computer Science · Decision Sciences · #Software Engineering Research #Scientific Computing and Data Management #Software Reliability and Analysis Research
- Prism: Dynamic and Flexible Benchmarking of LLMs Code Generation with Monte Carlo Tree Search
2025/04/07 by Vahid Majdinasab, Majdinasab, Vahid, Amin Nikanjam +3 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Software Engineering (cs.SE) #Text Readability and Simplification #Topic Modeling
- GitHub Copilot AI pair programmer: Asset or Liability?
2023/05/02 by Arghavan Moradi Dakhel, Vahid Majdinasab, Amin Nikanjam +4 · 1 citation
Computer Science · #Formal Methods in Verification #Software Engineering Research #Software Testing and Debugging Techniques
- An Efficient Model Maintenance Approach for MLOps
2024/12/05 by Forough Majidi, Majidi, Forough, Foutse Khomh +5 · 1 citation
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Semantic Web and Ontologies #Software Engineering (cs.SE)
- Efficiency vs. Alignment: Investigating Safety and Fairness Risks in Parameter-Efficient Fine-Tuning of LLMs
2025/11/01 by Mina Taraghi, Taraghi, Mina, Yann Pequignot +7 · 1 citation
Computer Science · Medicine · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing
- An empirical study of Policy-as-Code adoption in open-source software projects
2026/07/20 by Patrick Loic Foalem, Léuson Da Silva, Leuson Da Silva +2
Computer Science · #Software Engineering Research #Open Source Software Innovations #Software Engineering Techniques and Practices
- How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests
2026/07/23 by Iren Mazloomzadeh, Mohammad Mehdi Morovati, Foutse Khomh
#cs.SE #cs.LG