Abstract:
The purpose of this paper is to explore the representation capability of radial basis function (RBF) neural networks. The main results are: 1) the necessary and sufficien...Show MoreMetadata
Abstract:
The purpose of this paper is to explore the representation capability of radial basis function (RBF) neural networks. The main results are: 1) the necessary and sufficient condition for a function of one variable to be qualified as an activation function in RBF network is that the function is not an even polynomial, and 2) the capability of approximation to nonlinear functionals and operators by RBF networks is revealed, using sample data either in frequency domain or in time domain, which can be used in system identification by neural networks.<>
Published in: IEEE Transactions on Neural Networks ( Volume: 6, Issue: 4, July 1995)
DOI: 10.1109/72.392252
References is not available for this document.
Select All
1.
A. Wieland and R. Leighten, "Geometric analysis of neural network capacity", Proc. IEEE 1st ICNN. J, pp. 385-392, 1987.
2.
B. Irie and S. Miyake, "Capacity of three-layered pcrceptrons", Proc. IEEE ICNN, vol. 1, pp. 641-648, 1988.
3.
S. M. Carroll and B. W. Dickinson, "Construction of neural nets using radon transform", Proc. IJCNN Proc. I, pp. 607-611, 1989.
4.
K. Funahashi, "On the approximate realization of continuous mappings by neural networks", Neural Networks, vol. 2, pp. 183-192, 1989.
5.
H. N. Mhaskar and C. A. Micchelli, "Approximation by superposition of sigmoidal and radial functions", Advances on Applied Mathematics, vol. 13, pp. 350-373, 1992.
6.
G. Cybenko, "Approximation by superpositions of a sigmoidal function", Mathematics of Control Signals and Systems, vol. 2, no. 4, pp. 303-314, 1989.
7.
Y. Ito, "Representation of functions by superpositions of a step or sigmoidal function and their applications to neural network theory", Neural Networks, vol. 4, pp. 385-394, 1991.
8.
K. Hornik, "Approximation capabilities of multilayer feedforward networks", Neural Networks, vol. 4, pp. 251-257, 1991.
9.
T. Chen, H. Chen and R.-W. Liu, "Approximation capability in C(Rn) by multilayer feedforward networks and related problems", IEEE Trans. Neural Networks, vol. 6, no. 1, Jan. 1995.
10.
T. Chen, H. Chen and R.-W. Liu, "A constructive proof of Cybenko's approximation theorem and its extensions", Computing Science and Statistics, pp. 163-168, 1990-May.
11.
T. Chen and H. Chen, "Approximation to continuous functionals by neural networks with application to dynamic systems", IEEE Trans. Neural Networks, vol. 4, no. 6, Nov. 1993.
12.
T. Chen and H. Chen, "Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamic systems", IEEE Trans. Neural Networks, vol. 6, no. 4, July 1995.
13.
R. P. Lippmann, "Pattern classification using neural networks", IEEE Commun. Mag., vol. 27, pp. 47-64, 1989.
14.
J. Park and I. W. Sandberg, "Universal approximation using radialbasis-function networks", Neural Computation, vol. 3, pp. 246-257, 1991.
15.
D. Hush and B. Home, "Progress in supervised neural networks", IEEE SP Mag., Jan. 1993.
16.
J. E. Moody and C. J. Darken, "Fast learning in networks of locallytuned processing units", Neural Computation, vol. 1, pp. 281-293, 1989.
17.
F. Girosi and T. Poggio, Networks and the best approximation property, 1989.
18.
E. J. Hartman, J. D. Keeler and J. M. Kowalski, "Layered neural networks with Gaussian hidden units as universal approximators", Neural Computation, vol. 2, no. 2, pp. 210-215, 1990.
19.
S. Lee and R. M. Kil, "A Gaussian potential function network with hierarchically self-organizing learning", Neural Networks, vol. 4, pp. 207-224, 1991.
20.
J. Diedonne, Foundation oj Modern Analysis, New York and London:Academic, pp. 142, 1969.
21.
L. A. Liusternik and V. J. Sobolev, Elements of Functional Analysis (3rd ed. translated from Russian 2nd. ed.), New York:Wiley, 1974.
22.
T. Chen, "Approximation to nonlinear functionals in Hilbert space by superposition of sigmoidal functions", Kexue Tongbao, 1992.
23.
J. Park and I. W. Sandberg, "Approximation and radial-basis-function networks", Neural Computation, vol. 5, 1993.
24.
T. Chen and H. Chen, "L (R) approximation by RBF neural networks" in Chinese Annals of Mathematics.
25.
W. Rudin, Functional Analysis, New York:McGraw-Hill, 1973.
