vix.ing · top · new · best · stats · spec

Algorithm Design for Continual Learning in IoT Networks

2024/12/22 by Hao, Shugang, Lingjie Duan, Duan, Lingjie · 1 citation
Computer Science · Engineering · #Energy Efficient Wireless Sensor Networks #IoT-based Smart Home Systems #Advanced Data Processing Techniques

paper · pdf · doi:10.48550/arxiv.2412.16830

Abstract

Continual learning (CL) is a new online learning technique over sequentially generated streaming data from different tasks, aiming to maintain a small forgetting loss on previously-learned tasks. Existing work focuses on reducing the forgetting loss under a given task sequence. However, if similar tasks continuously appear to the end time, the forgetting loss is still huge on prior distinct tasks. In practical IoT networks, an autonomous vehicle to sample data and learn different tasks can route and alter the order of task pattern at increased travelling cost. To our best knowledge, we are the first to study how to opportunistically route the testing object and alter the task sequence in CL. We formulate a new optimization problem and prove it NP-hard. We propose a polynomial-time algorithm to achieve approximation ratios of (3)/(2) for underparameterized case and (3)/(2) + r1-T for overparameterized case, respectively, where r:=1-(n)/(m) is a parameter of feature number m and sample number n and T is the task number. Simulation results verify our algorithm's close-to-optimum performance.

Cited by

Related