2013/02/11 by Patrick Rodler, Rodler, Patrick, Kostyantyn Shchekotykhin +5
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #cs.AI
paper · pdf · doi:10.48550/arxiv.1302.2465
arXiv admin note: substantial text overlap with arXiv:1209.3734
arxiv created 2013/03/06 · arxiv updated 2013/03/07
The best currently known interactive debugging systems rely upon some meta-information in terms of fault probabilities in order to improve their efficiency. However, misleading meta information might result in a dramatic decrease of the performance and its assessment is only possible a-posteriori. Consequently, as long as the actual fault is unknown, there is always some risk of suboptimal interactions. In this work we present a reinforcement learning strategy that continuously adapts its behavior depending on the performance achieved and minimizes the risk of using low-quality meta information. Therefore, this method is suitable for application scenarios where reliable prior fault estimates are difficult to obtain. Using diverse real-world knowledge bases, we show that the proposed interactive query strategy is scalable, features decent reaction time, and outperforms both entropy-based and no-risk strategies on average w.r.t. required amount of user interaction.