Loading [MathJax]/extensions/MathZoom.js
Graph Generation with Recurrent and Graph Neural Networks | IEEE Conference Publication | IEEE Xplore

Graph Generation with Recurrent and Graph Neural Networks


Abstract:

Graph generation has applications as diverse as drug discovery, materials design, and code completion. In this paper, we propose a novel auto-regressive graph generation ...Show More

Abstract:

Graph generation has applications as diverse as drug discovery, materials design, and code completion. In this paper, we propose a novel auto-regressive graph generation model, where graph generation is viewed as a decision process. The proposed model combines the power of graph neural networks (GNNs) with generative modeling techniques, and incorporates both graph topology and node features, allowing the generation of graphs with desired properties. Extensive experiments on molecule datasets demonstrate the effectiveness of our approach, achieving high validity, diversity, and similarity to the target molecules.
Date of Conference: 18-19 November 2023
Date Added to IEEE Xplore: 31 January 2024
ISBN Information:
Conference Location: Beijing, China
References is not available for this document.

I. Introduction

Graphs are powerful representations for modeling complex relationships and structures in various domains, ranging from social networks and biological networks, to recommendation systems and knowledge graphs. Graph generative models aim to capture the underlying patterns, connectivity, and features present in real-world graphs, and generate new graph instances that exhibit similar characteristics. The ability to generate realistic and diverse graphs is of great importance in understanding and analyzing real-world phenomena, and it has been applied to code completion [1], materials design [2], and drug discoveries [3].

Select All
1.
M. Brockschmidt, M. Allamanis, A. L. Gaunt and O. Polozov, "Generative code modeling with graphs", International Conference on Learning Representations, 2019.
2.
T. Xie, X. Fu, O.-E. Ganea, R. Barzilay and T. S. Jaakkola, "Crystal diffusion variational autoencoder for periodic material generation", International Conference on Learning Representations, 2022.
3.
E. Hoogeboom, V. G. Satorras, C. Vignac and M. Welling, "Equivariant diffusion for molecule generation in 3d", International conference on machine learning, pp. 8867-8887, 2022.
4.
P. Erdos and A. Renyi, "On the evolution of random graphs", Publ. Math. Inst. Hung. Acad. Sci, vol. 5, no. 1, pp. 17-60, 1960.
5.
A.-L. Barabasi and R. Albert, "Emergence of scaling in random networks", Science, vol. 286, no. 5439, pp. 509-512, Oct. 1999.
6.
D. J. Watts and S. H. Strogatz, "Collective dynamics of 'small-worldnetworks", Nature, vol. 393, no. 6684, pp. 440-442, 1998.
7.
T. N. Kipf and M. Welling, "Semi-Supervised Classification with Graph Convolutional Networks", ICLR, pp. 14, 2017.
8.
P. Velickovic, G. Cucurull, A. Casanova, A. Romero, P. Lio and Y. Bengio, "Graph attention networks", International Conference on Learning Representations, 2018.
9.
L. Ruiz, F. Gama and A. Ribeiro, "Gated graph recurrent neural networks", IEEE Transactions on Signal Processing, vol. 68, pp. 6303-6318, 2020.
10.
D. P. Kingma, M. Welling et al., "An introduction to variational autoencoders", Foundations and Trends® in Machine Learning, vol. 12, no. 4, pp. 307-392, 2019.
11.
I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, et al., "Generative adversarial nets", Advances in neural information processing systems, vol. 27, 2014.
12.
J. You, R. Ying, X. Ren, W. Hamilton and J. Leskovec, "Graphrnn: Generating realistic graphs with deep auto-regressive models", International Conference on Machine Learning, pp. 5694-5703, 2018.
13.
Y. Li, O. Vinyals, C. Dyer, R. Pascanu and P. Battaglia, "Learning Deep Generative Models of Graphs", ICLR, Mar. 2018.
14.
K. Cho, B. Van Merrienboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, et al., Learning phrase representations using rnn encoder-decoder for statistical machine translation, 2014.
15.
R. Ramakrishnan, P. O. Dral, M. Rupp and O. A. von Lilienfeld, "Quantum chemistry structures and properties of 134 kilo molecules", Scientific Data, vol. 1, no. 1, pp. 140022, Aug. 2014.
16.
J. J. Irwin, T. Sterling, M. M. Mysinger, E. S. Bolstad and R. G. Coleman, "ZINC: A Free Tool to Discover Chemistry for Biology", Journal of Chemical Information and Modeling, vol. 52, no. 7, pp. 1757-1768, Jul. 2012.
17.
K. Madhawa, K. Ishiguro, K. Nakago and M. Abe, Graph-NVP: An Invertible Flow Model for Generating Molecular Graphs, May 2019.
18.
S. Honda, H. Akita, K. Ishiguro, T. Nakanishi and K. Oono, Graph Residual Flow for Molecular Graph Generation.
19.
C. Shi, M. Xu, Z. Zhu, W. Zhang, M. Zhang and J. Tang, "GraphAF: A Flow-based Autoregressive Model for Molecular Graph Generation", International Conference on Learning Representations, Sep 2019.
20.
M. Li, J. Zhou, J. Hu, W. Fan, Y. Zhang, Y. Gu, et al., "Dgl-lifesci: An open-source toolkit for deep learning on graphs in life science", ACS omega, vol. 6, no. 41, pp. 27 233-27 238, 2021.
21.
M. Liu, K. Yan, B. Oztekin and S. Ji, Graphebm: Molecular graph generation with energy-based models, 2021.
22.
C. Zang and F. Wang, "MoFlow: An Invertible Flow Model for Generating Molecular Graphs", Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 617-626, Aug. 2020.
Contact IEEE to Subscribe

References

References is not available for this document.