Title |
Reinforcement Learning-based HVAC Control Agent for Optimal Control of Particulate Matter in Railway Stations |
Authors |
권경빈(Kyung-bin Kwon) ; 홍수민(Sumin Hong) ; 허재행(Jae-Haeng Heo) ; 정호성(Hosung Jung) ; 박종영(Jong-young Park) |
DOI |
https://doi.org/10.5370/KIEE.2021.70.10.1594 |
Keywords |
Key Words : Deep Q-Network; Energy management; Markov decision process; Particulate matter; Reinforcement learning |
Abstract |
This study developed a reinforcement learning-based energy management agent that controls the concentration of fine dust by controlling the power consumption of energy facilities such as air conditioners and blowers in stations. To apply reinforcement learning, the problem was first defined based on the Markov decision-making process, and a model was developed to predict the concentration of fine dust in history using data correlated with fine dust. Based on the linear compensation function created based on this, the Deep Q-Network (DQN) method was applied to obtain the optimal policy based on the artificial neural network. In the case study, it was confirmed that convergence to the optimal policy was achieved through the learning process, and it was confirmed that the learned agent lowers the fine dust concentration by increasing the power consumption of the air conditioner when the fine dust concentration in the station rises above a certain level |