The Graph Neural Network Model | IEEE Journals & Magazine | IEEE Xplore

The Graph Neural Network Model


Abstract:

Many underlying relationships among data in several areas of science and engineering, e.g., computer vision, molecular chemistry, molecular biology, pattern recognition, ...Show More

Abstract:

Many underlying relationships among data in several areas of science and engineering, e.g., computer vision, molecular chemistry, molecular biology, pattern recognition, and data mining, can be represented in terms of graphs. In this paper, we propose a new neural network model, called graph neural network (GNN) model, that extends existing neural network methods for processing the data represented in graph domains. This GNN model, which can directly process most of the practically useful types of graphs, e.g., acyclic, cyclic, directed, and undirected, implements a function tau(G,n) isin IRm that maps a graph G and one of its nodes n into an m-dimensional Euclidean space. A supervised learning algorithm is derived to estimate the parameters of the proposed GNN model. The computational cost of the proposed algorithm is also considered. Some experimental results are shown to validate the proposed learning algorithm, and to demonstrate its generalization capabilities.
Published in: IEEE Transactions on Neural Networks ( Volume: 20, Issue: 1, January 2009)
Page(s): 61 - 80
Date of Publication: 09 December 2008

ISSN Information:

PubMed ID: 19068426
References is not available for this document.

I. Introduction

Data can be naturally represented by graph structures in several application areas, including proteomics [1], image analysis [2], scene description [3], [4], software engineering [5], [6], and natural language processing [7]. The simplest kinds of graph structures include single nodes and sequences. But in several applications, the information is organized in more complex graph structures such as trees, acyclic graphs, or cyclic graphs. Traditionally, data relationships exploitation has been the subject of many studies in the community of inductive logic programming and, recently, this research theme has been evolving in different directions [8], also because of the applications of relevant concepts in statistics and neural networks to such areas (see, for example, the recent workshops [9]–[12]).

Select All
1.
P. Baldi and G. Pollastri, "The principled design of large-scalerecursive neural network architectures-dag-RNNs and the protein structureprediction problem", J. Mach. Learn. Res., vol. 4, pp. 575-602, 2003.
2.
E. Francesconi, P. Frasconi, M. Gori, S. Marinai, J. Sheng, G. Soda, et al., "Logo recognition by recursive neural networks" in Lecture Notes in Computer Science — Graphics Recognition, Germany, Berlin:Springer-Verlag, 1997.
3.
E. Krahmer, S. Erk and A. Verleg, "Graph-based generation of referring expressions", Comput. Linguist., vol. 29, no. 1, pp. 53-72, 2003.
4.
A. Mason and E. Blake, "A graphical representation of the statespaces of hierarchical level-of-detail scene descriptions", IEEE Trans. Vis. Comput. Graphics, vol. 7, no. 1, pp. 70-75, Jan.-Mar. 2001.
5.
L. Baresi and R. Heckel, "Tutorial introduction to graph transformation: A software engineering perspective" in Lecture Notes in Computer Science, Germany, Berlin:Springer-Verlag, vol. 2505, pp. 402-429, 2002.
6.
C. Collberg, S. Kobourov, J. Nagra, J. Pitts and K. Wampler, "A system for graph-based visualization of the evolutionof software", Proc. ACM Symp. Software Vis., pp. 77-86, 2003.
7.
A. Bua, M. Gori and F. Santini, "Recursive neural networks applied to discourse representation theory" in Lecture Notes in Computer Science, Germany, Berlin:Springer-Verlag, vol. 2415, 2002.
8.
L. De Raedt, Logical and Relational Learning, New York:Springer-Verlag, 2008.
9.
Proc. Int. Workshop Statist. Relat. Learn. Connect. Other Fields, 2004.
10.
Proc. Int. Workshop Sub-Symbol. Paradigms Structured Domains, 2005.
11.
Proc. 3rd Int. Workshop Mining Graphs Trees Sequences, 2005.
12.
Proc. 4th Int. Workshop Mining Graphs Trees Sequences, 2006.
13.
A. Srinivasan, S. Muggleton, R. King and M. Sternberg, "Mutagenesis: Ilp experiments in a non-determinatebiological domain", Proc. 4th Int. Workshop Inductive Logic Programm., pp. 217-232, 1994.
14.
T. Pavlidis, Structural Pattern Recognition, New York:Springer-Verlag, 1977.
15.
M. Bianchini, M. Maggini, L. Sarti and F. Scarselli, "Recursive neural networks learn to localizefaces", Phys. Rev. Lett., vol. 26, no. 12, pp. 1885-1895, Sep. 2005.
16.
S. Haykin, Neural Networks: A Comprehensive Foundation, New York:Prentice-Hall, 1994.
17.
P. Frasconi, M. Gori and A. Sperduti, "A general framework for adaptive processingof data structures", IEEE Trans. Neural Netw., vol. 9, no. 5, pp. 768-786, Sep. 1998.
18.
S. Brin and L. Page, "The anatomy of a large-scale hypertextualweb search engine", Proc. 7th World Wide Web Conf., pp. 107-117, 1998-Apr.
19.
A. Sperduti and A. Starita, "Supervised neural networksfor the classification of structures", IEEE Trans. Neural Netw., vol. 8, no. 2, pp. 429-459, Mar. 1997.
20.
M. Hagenbuchner, A. Sperduti and A. C. Tsoi, "A self-organizing map for adaptiveprocessing of structured data", IEEE Trans. Neural Netw., vol. 14, no. 3, pp. 491-505, May 2003.
21.
J. Kleinberg, "Authoritative sources in ahyperlinked environment", J. ACM, vol. 46, no. 5, pp. 604-632, 1999.
22.
A. C. Tsoi, G. Morini, F. Scarselli, M. Hagenbuchner and M. Maggini, "Adaptive ranking of web pages", Proc. 12th World Wide Web Conf., pp. 356-365, 2003-May.
23.
M. Bianchini, P. Mazzoni, L. Sarti and F. Scarselli, "Face spotting in color images using recursiveneural networks", Proc. 1st Int. Workshop Artif. Neural Netw. Pattern Recognit., pp. 76-81, 2003-Sep.
24.
M. Bianchini, M. Gori and F. Scarselli, "Processing directed acyclic graphs withrecursive neural networks", IEEE Trans. Neural Netw., vol. 12, no. 6, pp. 1464-1470, Nov. 2001.
25.
A. KÜchler and C. Goller, "Inductive learning in symbolic domains using structure-driven recurrent neural networks" in Lecture Notes in Computer Science, Germany, Berlin:Springer-Verlag, vol. 1137, Sep. 1996.
26.
T. Schmitt and C. Goller, "Relating chemical structureto activity: An application of the neural folding architecture", Proc. Workshop Fuzzy-Neuro Syst./Conf. Eng. Appl. Neural Netw., pp. 170-177, 1998.
27.
M. Hagenbuchner and A. C. Tsoi, "A supervised training algorithmfor self-organizing maps for structures", Pattern Recognit. Lett., vol. 26, no. 12, pp. 1874-1884, 2005.
28.
M. Gori, M. Maggini, E. Martinelli and F. Scarselli, "Learning user profiles in NAUTILUS", Proc. Int. Conf. Adaptive Hypermedia Adaptive Web-Based Syst., pp. 323-326, 2000-Aug.
29.
M. Bianchini, P. Mazzoni, L. Sarti and F. Scarselli, "Face spotting in color images using recursiveneural networks", Proc. Italian Workshop Neural Netw., 2003-Jul.
30.
B. Hammer and J. Jain, "Neural methods for non-standard data", Proc. 12th Eur. Symp. Artif. Neural Netw., pp. 281-292, 2004.
Contact IEEE to Subscribe

References

References is not available for this document.