SARSA-Based CoAP Mode and Route Selection Joint Optimization in Power Underground Pipe Gallery

With the rigid quality of service (QoS) requirements of electricity services, wired communication networks in the urban power underground pipe gallery is facing many challenges. Traditional communication protocol and route selection can no longer supply the differentiated QoS demand of electricity services. This paper proposes a state-action-reward-state-action (SARSA)-based constrained application protocol (CoAP) mode and route selection joint optimization algorithm. The optimization objective is to jointly minimize the transmission delay and packet loss under the electromagnetic interference. Then, the proposed algorithm has been compared with shortest route selection (SRS)-based confirmed and non-confirmed mode algorithms through simulations. The simulation results demonstrate that the proposed algorithm can satisfy differentiated QoS requirements for urban power underground pipe gallery data transmission.