Loading [MathJax]/extensions/MathMenu.js
Attentional Neural Factorization Machine for Web Services Classification via Exploring Content and Structural Semantics | IEEE Conference Publication | IEEE Xplore

Attentional Neural Factorization Machine for Web Services Classification via Exploring Content and Structural Semantics


Abstract:

Due to the rapid development of Web 2.0, a lot of Web services emerge over the Internet. How to efficiently manage Web services through classification is very important f...Show More

Abstract:

Due to the rapid development of Web 2.0, a lot of Web services emerge over the Internet. How to efficiently manage Web services through classification is very important for Web service discovery. Although there have been a lot of works on Web services classification, they still have drawbacks. On one side, the feature extraction from the service repository is insufficient, which will influence the classification accuracy no matter what classification model is used. On the other side, the extracted features are used with the same weights and they lack depth fusion when training the classification model. In real-world application scenarios, different feature interactions often have different predictive capabilities, and not all feature interactions contain useful or positive information for estimating the target. In addition, both low-and high-order feature interactions are usually underlain real-world data. To solve the problems above, this paper proposes a novel Web services classification approach via fully exploring and integrating the content and structural semantics of Web services. In the proposed approach, the content representation is explored with the BERT-based document embedding model, and the structural representation is explored with the Node2vec network embedding model. Finally, attentional neural factorization machine is used for both the deep fusion of features and Web services classification. A set of experiments are done on real-world datasets crawled from Programmable Web. And solid experimental results show that the proposed approach outperforms the state-of-the-art approach and the other baselines.
Date of Conference: 18-23 July 2022
Date Added to IEEE Xplore: 30 September 2022
ISBN Information:

ISSN Information:

Conference Location: Padua, Italy

Funding Agency:

References is not available for this document.

I. Introduction

Web services are self-contained, modular, distributed, dynamic applications that can be described, published, located, or accessed over the network to create products, processes, and supply chains. Mashups are a new type of Web service that is composed of Web APIs. Mashups leverage content from different data sources to create new services. Hereafter, Mashups and Web APIs are also referred to as Web services in this work. Due to the advantages of Mashup technology, more and more developers and ordinary users tend to use Mashups to solve their business requirements. The great demand from users stimulates developer users to publish Web APIs on the Internet. Thus, a plentiful number of Web services are published on the Internet. Take the well-known ProgrammableWeb platform as an example, which hosts over 24,000 APIs and 8,000 Mashups. With such a huge number of Web services on the Web, how to manage them efficiently by means of web services classification according to their functionality is of great importance for further tasks, like service discovery or selection, service composition, and service recommendation [1]. However, there are two main challenging issues for accurate Web services classification. The first one is how to extract sufficient multi-dimensional features from the service repository since functional features of Web services are very limited by extracting from service descriptions. The second one is how to train an effective classification model with the extracted features since complex relationships may exist among different features.

Select All
1.
G. Kang, J. Liu, B. Cao and M. Cao, "Neural and Attentional Factorization Machine-Based Web API Recommendation for Mashup Development", IEEE Transactions on Network and Service Management, pp. 4183-4196, 2021.
2.
T. Hofmann, "Probabilistic Latent Semantic Analysis", Conference on Uncertainty in Artificial Intelligence, pp. 289-296, 1999.
3.
D. M. Blei, A. Y. Ng and M. I. Jordan, "Latent Dirichlet Allocation", the Journal of machine Learning research, vol. 3, pp. 993-1022, 2003.
4.
N. Majumder, S. Poria, A. Gelbukh and E. Cambria, "Deep Learning-based Document Modeling for Personality Detection from Text", IEEE Intelligent Systems, vol. 32, no. 2, pp. 74-79, 2017.
5.
H. Ye, B. Cao, J. Chen, J. Liu, Y. Wen and J. Chen, "A Web Services Classification Method Based on GCN", IEEE International Conference on Parallel Distributed Processing with Applications Big Data Cloud Computing Sustainable Computing Communications Social Computing Networking, pp. 1107-1114, 2019.
6.
J. Tang, M. Qu, M. Wang, M. Zhang, J. Yan and Q. Mei, "LINE: Large-scale Information Network Embedding", International Conference on World Wide Web, pp. 1067-1077, 2015.
7.
Y. Xiao, J. Liu, G. Kang and B. Cao, "LDNM: A General Web Service Classification Framework via Deep Fusion of Structured and Unstructured Features", IEEE Transactions on Network and Service Management, pp. 3858-3872, 2021.
8.
X. Zhang and L. Li, "Attentional Neural Factorization Machines for Knowledge Tracing", International Conference on Knowledge Science Engineering and Management, pp. 319-330, 2021.
9.
H. Jelodar, Y. Wang, C. Yuan, X. Feng, X. Jiang, Y. Li, et al., "Latent Dirichlet Allocation (LDA) and Topic Modeling: Models Applications Survey", Multimedia Tools and Applications, vol. 78, no. 11, pp. 15169-15211, 2019.
10.
X. Liu, S. Agarwal, C. Ding and Q. Yu, "An LDA-SVM Active Learning Framework for Web Service Classification", IEEE International Conference on Web Services, pp. 49-56, 2016.
11.
G. Kang, Y. Xiao, J. Liu, Y. Cao, B. Cao, X. Zhang, et al., "Tatt-BiLSTM: Web service classification with topical attention-based BiLSTM", Concurrency and Computation: Practice and Experience, vol. 33, no. 16, pp. 1-13, 2021.
12.
L. Chen, Y. Wang, Q. Yu, Z. Zheng and J. Wu, "WT-LDA: User Tagging Augmented LDA for Web Service Clustering", International Conference on Service-oriented Computing, pp. 162-176, 2013.
13.
J. Devlin, M.-W. Chang, K. Lee and K. Toutanova, "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding", arXiv preprint, 2018.
14.
Y. Yang, W. Ke, W. Wang and Y. Zhao, "Deep Learning for Web Services Classification", IEEE International Conference on Web Services, pp. 440-442, 2019.
15.
Y. Yang, N. Qamar, P. Liu, K. Grolinger, W. Wang, Z. Li, et al., "ServeNet: A Deep Neural Network for Web Services Classification", IEEE International Conference on Web Services, pp. 168-175, 2020.
16.
H. Ye, B. Cao, Z. Peng, T. Chen, Y. Wen and J. Liu, "Web Services Classification Based on Wide Bi-LSTM Model", IEEE Access, vol. 7, pp. 43697-43706, 2019.
17.
S. Cao, W. Lu and Q. Xu, "Grarep: Learning Graph Representations with Global Structural Information", ACM International on Conference on Information and Knowledge Management, pp. 891-900, 2015.
18.
K. Cheng, J. Li and H. Liu, "Unsupervised Feature Selection in Signed Social Networks", ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 777-786, 2017.
19.
A. Grover and J. Leskovec, "Node2vec: Scalable Feature Learning for Networks", ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 855-864, 2016.
20.
O. Adeleye, J. Yu, J. Ruan and Q. Z. Sheng, "Evaluating Random Walk-based Network Embeddings for Web Service Applications", Australasian Database Conference, pp. 198-205, 2020.
21.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, et al., "Attention is All You Need", Advances in Neural Information Processing Systems, pp. 5998-6008, 2017.

Contact IEEE to Subscribe

References

References is not available for this document.