2018/09/03 by Roman Budylin, Alexey Drutsa, Budylin, Roman +7
Computer Science · #68M11 #68M20 #FOS: Computer and information sciences #H.1.2 #H.3.4 #H.5.2 #Human-Computer Interaction (cs.HC) #Performance (cs.PF) #Service-Oriented Architecture and Web Services #Software Engineering (cs.SE)
paper · pdf · doi:10.48550/arxiv.1809.00661
openalex publication_date 2018/09/03 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Development of the majority of the leading web services and software products today is generally guided by data-driven decisions based on evaluation that ensures a steady stream of updates, both in terms of quality and quantity. Large internet companies use online evaluation on a day-to-day basis and at a large scale. The number of smaller companies using A/B testing in their development cycle is also growing. Web development across the board strongly depends on quality of experimentation platforms. In this tutorial, we overview state-of-the-art methods underlying everyday evaluation pipelines at some of the leading Internet companies. Software engineers, designers, analysts, service or product managers --- beginners, advanced specialists, and researchers --- can learn how to make web service development data-driven and do it effectively.