Tabular Dyna-Q Algorithm for Online Calculation of LQR Gains: A Simulation Study

This paper presents a novel approach for the online calculation of Linear Quadratic Regulator (LQR) gains using the Tabular Dyna-Q algorithm. By leveraging Q-learning, this technique enables the determination of gains for unknown dynamic systems by using input-output data only. The proposed algorithm is particularly advantageous for situations where acquiring input-output data is expensive or time-consuming, as it effectively reduces computation time by reusing previous data. To validate the accuracy of the calculations and control scheme, a simulation example is provided. The results indicate the effectiveness of the Tabular Dyna-Q algorithm in accurately computing LQR gains and its potential application in real-world scenarios. This research contributes to advancing the field of control theory by offering an efficient and reliable method for online gain calculation in dynamic systems.