I. Introduction
Nowadays, the distributed Internet of Things (IoT) systems, such as Internet of Vehicles [1], [2], [3] and Industrial IoT [4], [5], [6] have gained extensive attention due to its remarkable ability of data collection and fault tolerance. Augmented with sophisticated artificial intelligence techniques, the distributed IoT systems can support intelligent applications over a spectrum of real-world domains, such as fault detection [7], medical diagnosis [8], and image recognition [9]. As the demand of privacy protection prevails, federated learning (FL), as a promising distributed learning mode [10], [11], can be seamlessly applied to the distributed IoT systems for privacy-preserving and cooperative training.