Loading [MathJax]/extensions/MathMenu.js
An Improved Reconstruction-Based Multiattribute Contrastive Learning for Digital-Twin-Enabled Industrial System | IEEE Journals & Magazine | IEEE Xplore

An Improved Reconstruction-Based Multiattribute Contrastive Learning for Digital-Twin-Enabled Industrial System


Abstract:

Digital twin (DT) is a promising technology for responding to Industry 4.0 and realizing comprehensive automation and virtualization. In the Web3.0-powered 5G/6G era, the...Show More

Abstract:

Digital twin (DT) is a promising technology for responding to Industry 4.0 and realizing comprehensive automation and virtualization. In the Web3.0-powered 5G/6G era, the expansion of the industrial data and closer interaction among cross-industrial entities pose new security challenges for DT industrial systems. As a prevalent computing paradigm, Graph Anomaly Detection provides an effective solution to ensure the security of DT industrial systems. However, the existing unsupervised graph anomaly detection methods tend to treat multiple graph attributes in isolation during the reconstruction process, resulting in insufficient semantics and suboptimal reconstruction performance. To overcome these challenges, we propose a multiattribute contrastive learning framework, which realizes graph anomaly detection by capturing both graph attribute patterns and their hidden relationships. First, we use an improved multiattribute aligned reconstruction approach to represent the anomaly information effectively. Besides that, the positive instance aggregation-based contrastive constraints are proposed, which can reduce the loss generated by mappings between different data dimension in feature representation space. Finally, to verify our proposal, extensive experiments have been conducted on five benchmark datasets, and the results show that our method obtains the state-of-the-art performance.
Published in: IEEE Internet of Things Journal ( Volume: 12, Issue: 4, 15 February 2025)
Page(s): 3670 - 3679
Date of Publication: 17 October 2024

ISSN Information:

Funding Agency:

References is not available for this document.

I. Introduction

The Fourth Industrial Revolution is in bloom, and the emergence of the global Covid-19 pandemic has further accelerated the industrial digital transformation. People’s desire for full automation and virtualization in industry is increasingly intense. Under these conditions, as one of the key technologies, digital twin (DT) has received extensive attention and research [1]. DT provides a digital mirror of the elements and attributes in physical system. Through this way, the supervision and decision making of the real world can be made by the operation in the digital world. In the Web3.0-enabled 5G/6G era, the scale of industrial data is further expanded, and the cooperation among cross-industrial entities is much closer [2]. However, the communication medium becomes a potential weakness when facing data attacks, posing a greater challenge to the security of DT industrial systems [3], [4]. DT industrial systems need a more transparent and trusted way to exchange massive amounts of data. To achieve the above goals, blockchain, with its decentralized, tamper-proof, and traceable nature, ensures a secure exchange among different DT systems [2]. For the decentralized DT industrial systems, the security and reliability of the interaction process among entities are guaranteed through blockchain and various encryption methods. Despite this, when the interaction behavior itself exhibits anomalies, it is hard to address the challenge effectively using only blockchain technology. Meanwhile, as a natural graph structure, each entity in the DT industrial systems with decentralized architecture serves as a node, and the interactions among them form the edges in the graph. In this context, graph anomaly detection methods provide a practical solution to capture the abnormal behavior in the system by modeling the decentralized system as a graph and utilizing graph-based techniques.

Select All
1.
L. Sciullo, A. De Marchi, A. Trotta, F. Montori, L. Bononi and M. Di Felice, "Relativistic digital twin: Bringing the IoT to the future", Future Gener. Comput. Syst., vol. 153, pp. 521-536, Apr. 2024.
2.
S. Mihai et al., "Digital twins: A survey on enabling technologies challenges trends and future prospects", IEEE Commun. Surveys Tuts., vol. 24, no. 4, pp. 2255-2291, 4th Quart. 2022.
3.
J. Cai, W. Liang, X. Li, K. Li, Z. Gui and M. K. Khan, "GTxChain: A secure IoT smart blockchain architecture based on graph neural network", IEEE Internet Things J., vol. 10, no. 24, pp. 21502-21514, Dec. 2023.
4.
S. Alem, D. Espes, L. Nana, E. Martin and F. De Lamotte, "A novel bi-anomaly-based intrusion detection system approach for industry 4.0", Future Gener. Comput. Syst., vol. 145, pp. 267-283, Aug. 2023.
5.
J. Li, H. Dani, X. Hu and H. Liu, "Radar: Residual analysis for anomaly detection in attributed networks", Proc. 26th Int. Joint Conf. Artif. Intell., pp. 2152-2158, 2017.
6.
S. Lu et al., "A nonlocal feature self-similarity based tensor completion method for video recovery", Neurocomputing, vol. 580, May 2024.
7.
C. Dai, Y. Huang and W.-C. Chien, "A sparse attack method on skeleton-based human action recognition for intelligent Metaverse application", Future Gener. Comput. Syst., vol. 143, pp. 51-60, Jun. 2023.
8.
Z. Peng, M. Luo, J. Li, L. Xue and Q. Zheng, "A deep multi-view framework for anomaly detection on attributed networks", IEEE Trans. Knowl. Data Eng., vol. 34, no. 6, pp. 2539-2552, Jun. 2022.
9.
L. Yan, C. Luo and R. Shao, "Discrete log anomaly detection: A novel time-aware graph-based link prediction approach", Inf. Sci., vol. 647, Nov. 2023.
10.
E. Caville, W. W. Lo, S. Layeghy and M. Portmann, "Anomal-E: A self-supervised network intrusion detection system based on graph neural networks", Knowl.-Based Syst., vol. 258, Dec. 2022.
11.
G. Dong et al., "Graph neural networks in IoT: A survey", ACM Trans. Sens. Netw., vol. 19, no. 2, pp. 1-50, 2023.
12.
S. Wu, F. Sun, W. Zhang, X. Xie and B. Cui, "Graph neural networks in recommender systems: A survey", ACM Comput. Surv., vol. 55, no. 5, pp. 1-37, 2022.
13.
L. Sun et al., "Adversarial attack and defense on graph data: A survey", IEEE Trans. Knowl. Data Eng., vol. 35, no. 8, pp. 7693-7711, Aug. 2023.
14.
X. Yang, Z. Song, I. King and Z. Xu, "A survey on deep semi-supervised learning", IEEE Trans. Knowl. Data Eng., vol. 35, no. 9, pp. 8934-8954, Sep. 2023.
15.
C. Ren, C. Chen, X. Wen, Y. Ma, S. Zhu and X. Guan, "Joint design of communication and computing for digital-twin-enabled aircraft final assembly", IEEE Internet Things J., vol. 10, no. 18, pp. 15872-15886, Sep. 2023.
16.
S. Sai, M. Prasad, A. Upadhyay, V. Chamola and N. Herencsar, "Confluence of digital twins and Metaverse for consumer electronics: Real world case studies", IEEE Trans. Consum. Electron., vol. 70, no. 1, pp. 3194-3203, Feb. 2024.
17.
M. García-Valls and A. M. Chirivella-Ciruelos, "CoTwin: Collaborative improvement of digital twins enabled by blockchain", Future Gener. Comput. Syst., vol. 157, pp. 408-421, Aug. 2024.
18.
T. Mortlock, D. Muthirayan, S.-Y. Yu, P. P. Khargonekar and M. Abdullah Al Faruque, "Graph learning for cognitive digital twins in manufacturing systems", IEEE Trans. Emerg. Topics Comput., vol. 10, no. 1, pp. 34-45, Jan.–Mar. 2022.
19.
L. Xie, D. Pi, X. Zhang, J. Chen, Y. Luo and W. Yu, "Graph neural network approach for anomaly detection", Measurement, vol. 180, Aug. 2021.
20.
B. Perozzi and L. Akoglu, "Scalable anomaly ranking of attributed neighborhoods", Proc. SIAM Int. Conf. Data Min, pp. 207-215, 2016.
21.
S. M. Erfani, S. Rajasegarar, S. Karunasekera and C. Leckie, "High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning", Pattern Recognit., vol. 58, pp. 121-134, Oct. 2016.
22.
C. Dai, H. Cheng and X. Liu, "A tucker decomposition based on adaptive genetic algorithm for efficient deep model compression", Proc. IEEE Int. Conf. High Perform. Comput. Commun. IEEE 18th Int. Conf. Smart City IEEE 6th Int. Conf. Data Sci. Syst. (HPCC/SmartCity/DSS), pp. 507-512, 2020.
23.
D. W. Shu, Y. Kim and J. Kwon, "Localized curvature-based combinatorial subgraph sampling for large-scale graphs", Pattern Recognit., vol. 139, Jul. 2023.
24.
X. Ma et al., "A comprehensive survey on graph anomaly detection with deep learning", IEEE Trans. Knowl. Data Eng., vol. 35, no. 12, pp. 12012-12038, Dec. 2023.
25.
K. Ding, J. Li, R. Bhanushali and H. Liu, "Deep anomaly detection on attributed networks", Proc. SIAM Int. Conf. Data Min., pp. 594-602, 2019.
26.
M. Shao, Y. Lin, Q. Peng, J. Zhao, Z. Pei and Y. Sun, "Learning graph deep autoencoder for anomaly detection in multi-attributed networks", Knowl.-Based Syst., vol. 260, Jan. 2023.
27.
Y. Feng, J. Chen, Z. Liu, H. Lv and J. Wang, "Full graph autoencoder for one-class group anomaly detection of IIoT system", IEEE Internet Things J., vol. 9, no. 21, pp. 21886-21898, Nov. 2022.
28.
X. Luo et al., "ComGA: Community-aware attributed graph anomaly detection", Proc. ACM Int. Conf. Web Search Data Min., pp. 657-665, 2022.
29.
Y. Liu, Z. Li, S. Pan, C. Gong, C. Zhou and G. Karypis, "Anomaly detection on attributed networks via contrastive self-supervised learning", IEEE Trans. Neural Netw. Learn. Syst., vol. 33, no. 6, pp. 2378-2392, Jun. 2022.
30.
Y. Xie, Z. Xu, J. Zhang, Z. Wang and S. Ji, "Self-supervised learning of graph neural networks: A unified review", IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 2, pp. 2412-2429, Feb. 2023.

Contact IEEE to Subscribe

References

References is not available for this document.