Academic Articles & Research Papers

The Graph Neural Network Model

Many underlying relationships among data in several areas of science and engineering, e.g., computer vision, molecular chemistry, molecular biology, pattern recognition, and data mining, can be represented in terms of graphs. In this paper,...

Cellular neural networks

A novel class of information-processing systems called cellular neural networks is proposed. Like neural networks, they are large-scale nonlinear circuits which process signals in real time. Like cellular automata, they are made of a massiv...

Cellular neural networks: applications

The theory of a novel class of information-processing systems, called cellular neural networks, which are capable of high-speed parallel signal processing, was presented in a previous paper (see ibid., vol.35, no.10, p.1257-72, 1988). A dyn...

Neural networks: an introduction

In this chapter, neural networks are discussed. The present field of neural networks links a number of closely related areas, such as parallel distributed processing, connectionism and neural computing, these being brought together with the...

Neural networks for wave forecasting

Neural networks — A comprehensive foundation

Neural networks for pattern recognition

From the Publisher: This is the first comprehensive treatment of feed-forward neural networks from the perspective of statistical pattern recognition. After introducing the basic concepts, the book examines techniques for modelling probabi...

NEURAL NETWORK DYNAMICS

Neural network modeling is often concerned with stimulus-driven responses, but most of the activity in the brain is internally generated. Here, we review network models of internally generated activity, focusing on three types of network dy...

Introduction to artificial neural networks

The coupling of computer science and theoretical bases such as nonlinear dynamics and chaos theory allows the creation of 'intelligent' agents, such as artificial neural networks (ANNs), able to adapt themselves dynamically to problems of h...

Approximation theory of the MLP model in neural networks

In this survey we discuss various approximation-theoretic problems that arise in the multilayer feedforward perceptron (MLP) model in neural networks. The MLP model is one of the more popular and practical of the many neural network models....

Recurrent Neural Network Regularization

We present a simple regularization technique for Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units. Dropout, the most successful technique for regularizing neural networks, does not work well with RNNs and LSTMs. In ...

Tensorizing Neural Networks

Deep neural networks currently demonstrate state-of-the-art performance in several domains. At the same time, models of this class are very demanding in terms of computational resources. In particular, a large amount of memory is required b...

Are artificial neural networks black boxes?

Artificial neural networks are efficient computing models which have shown their strengths in solving hard problems in artificial intelligence. They have also been shown to be universal approximators. Notwithstanding, one of the major criti...

Bayesian Learning for Neural Networks

Theory of the backpropagation neural network

The author presents a survey of the basic theory of the backpropagation neural network architecture covering architectural design, performance measurement, function approximation capability, and learning. The survey includes previously know...

Forecasting wind with neural networks

Cellular neural networks: theory

A novel class of information-processing systems called cellular neural networks is proposed. Like neural networks, they are large-scale nonlinear analog circuits that process signals in real time. Like cellular automata, they consist of a m...

Neural Networks in Robotics

Neural networks: a tutorial

1. A Structure of an Artificial Neural Network. 2. Applications of Neural Networks. 3. The Early Years. 4. The Hopfield Net. 5. Self Organizing Maps. 6. Backpropagation. 7. Learning Laws and Continued Taxonomy. 8. Adaptive Resonance Theory....

Modular learning in neural networks

In the development of large-scale knowledge networks much recent progress has been inspired by connections to neurobiology. An important component of any neural network is an accompanying learning algorithm. Such an algorithm, to be biologi...