2014/10/20 by Song Fang, Fang, Song
Computer Science · Engineering · #Blind Source Separation Techniques #Control Systems and Identification #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Fault Detection and Control Systems #Information Theory (cs.IT) #Optimization and Control (math.OC) #Systems and Control (eess.SY) #electronic engineering #information engineering
paper · pdf · doi:10.48550/arxiv.1410.5192
openalex publication_date 2014/10/20 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
This paper aims at obtaining universal laws and absolute lower bounds of feedback systems using information theory. The feedback system setup is that with causal plants and causal controllers. Three laws (entropy rate never decreases, generalized Bode integral, and absolute lower bound in variance minimization) are obtained, which are in entropy domain, frequency domain, and time domain, respectively. Those laws characterize the fundamental limitations of such systems imposed by the feedback mechanism. Two new notions, negentropy rate and Gaussianity-whiteness measure (joint Shannon-Wiener entropy), are proposed to facilitate the analysis. Topics such as whiteness-Gaussianity-variance decomposition, Gaussianing-whitening control (the maximum Gaussianity-whiteness measure principle), whitening control (spectrum/spectral flattening control), generalized Bode plot, and so on are also discussed. The special case of linear time-invariant feedback systems is considered in the end.