Automated Web Application Testing: End-to-End Test Case Generation with Large Language Models and Screen Transition Graphs

2025/06/03 by Ngan Le, Quan M. Bui, Le, Nguyen-Khang +12 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #Software Engineering (cs.SE) #Software Reliability and Analysis Research #Software System Performance and Reliability #Software Testing and Debugging Techniques

paper · pdf · doi:10.48550/arxiv.2506.02529

openalex publication_date 2025/06/03 · openalex created_date 2025/10/14 · openalex updated_date 2026/08/03

Abstract

Web applications are critical to modern software ecosystems, yet ensuring their reliability remains challenging due to the complexity and dynamic nature of web interfaces. Recent advances in large language models (LLMs) have shown promise in automating complex tasks, but limitations persist in handling dynamic navigation flows and complex form interactions. This paper presents an automated system for generating test cases for two key aspects of web application testing: site navigation and form filling. For site navigation, the system employs screen transition graphs and LLMs to model navigation flows and generate test scenarios. For form filling, it uses state graphs to handle conditional forms and automates Selenium script generation. Key contributions include: (1) a novel integration of graph structures and LLMs for site navigation testing, (2) a state graph-based approach for automating form-filling test cases, and (3) a comprehensive dataset for evaluating form-interaction testing. Experimental results demonstrate the system's effectiveness in improving test coverage and robustness, advancing the state of web application testing.

Citations

• A Survey on Web Application Testing: A Decade of Evolution
• A Survey on LLM-as-a-Judge
• GPT-4o System Card
• The Llama 3 Herd of Models
• WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models
• Counterfactually Auditable Lifecycle Certification for Autonomous Agents
• Autonomous Tester Agent Benchmark
• A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis
• Mind2Web: Towards a Generalist Agent for the Web
• Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
• GPT-4 Technical Report
• Toolformer: Language Models Can Teach Themselves to Use Tools
• WebGPT: Browser-assisted question-answering with human feedback
• A Note on Two Problems in Connexion with Graphs

Cited by

• AI Agents for Web Testing: A Case Study in the Wild
• A Privacy-Preserving Recommender for Filling Web Forms Using a Local Large Language Model

Related

• Finetuning LLMs for Automatic Form Interaction on Web-Browser in Selenium Testing Framework
• Large Language Models for Automated Web-Form-Test Generation: An Empirical Study
• A Survey on Web Testing: On the Rise of AI and Applications in Industry
• A Survey on Web Application Testing: A Decade of Evolution
• Feature-Driven End-To-End Test Generation