Artificial neural networks neuron

Artificial Neural Networks (ANNs) are information processing imits which process information in a way that is motivated by the functionality of the biological nervous system. Just as the brain consists of neurons which are connected with one another, an ANN comprises interrelated artificial neurons. The neurons work together to solve a given problem. 

Artificial Neural Networks (ANNs) attempt to emulate their biological counterparts. McCulloch and Pitts (1943) proposed a simple model of a neuron, and Hebb (1949) described a technique which became known as Hebbian learning. Rosenblatt (1961), devised a single layer of neurons, called a Perceptron, that was used for optical pattern recognition. 

Aqueous solubility is selected to demonstrate the E-state application in QSPR studies. Huuskonen et al. modeled the aqueous solubihty of 734 diverse organic compounds with multiple linear regression (MLR) and artificial neural network (ANN) approaches [27]. The set of structural descriptors comprised 31 E-state atomic indices, and three indicator variables for pyridine, ahphatic hydrocarbons and aromatic hydrocarbons, respectively. The dataset of734 chemicals was divided into a training set ( =675), a vahdation set (n=38) and a test set (n=21). A comparison of the MLR results (training, r =0.94, s=0.58 vahdation r =0.84, s=0.67 test, r =0.80, s=0.87) and the ANN results (training, r =0.96, s=0.51 vahdation r =0.85, s=0.62 tesL r =0.84, s=0.75) indicates a smah improvement for the neural network model with five hidden neurons. These QSPR models may be used for a fast and rehable computahon of the aqueous solubihty for diverse orgarhc compounds. 

The structural unit of artificial neural networks is the neuron, an abstraction of the biological neuron a typical biological neuron is shown in Fig. 44.1. Biological neurons consist of a cell body from which many branches (dendrites and axon) grow in various directions. Impulses (external or from other neurons) are received through the dendrites. In the cell body, these signals are sifted and integrated. 

In the human brain, it is the combined efforts of many neurons acting in concert that creates complex behavior this is mirrored in the structure of an ANN, in which many simple software processing units work cooperatively. It is not just these artificial units that are fundamental to the operation of ANNs so, too, are the connections between them. Consequently, artificial neural networks are often referred to as connectionist models. 

Artificial neural networks (ANN) are computing tools made up of simple, interconnected processing elements called neurons. The neurons are arranged in layers. The feed-forward network consists of an input layer, one or more hidden layers, and an output layer. ANNs are known to be well suited for assimilating knowledge about complex processes if they are properly subjected to input-output patterns about the process. 

Fig. 7. Artificial neural network model. Bioactivities and descriptor values are the input and a final model is the output. Numerical values enter through the input layer, pass through the neurons, and are transformed into output values the connections (arrows) are the numerical weights. As the model is trained on the Training Set, the system-dependent variables of the neurons and the weights are determined.

Figure 5.3 Internal organisation of an artificial neural network. In general, there is a neuron per original variable in the input layer of neurons and all neurons are interconnected. The number of neurons in the output layer depends on the particular application (see text for details).

A number of researchers have tried training neural networks to achieve color constancy. A neural network basically consists of a set of nodes connected by weights (McClelland and Rumelhart 1986 Rumelhart and McClelland 1986 Zell 1994). Artificial neural networks are an abstraction from biological neural networks. Figure 8.2 shows a motor neuron in (a) and a network of eight artificial neurons on the right. A neuron may be in one of... 

Figure 8.2 A motor neuron (a) and small artificial neural network (b). A neuron collects signals from other neurons via its dendrites. If the neuron is sufficiently activated, it sends a signal to other neurons via its axon. Artificial neural network are often grouped into layers. Data is entered through the input layer. It is processed by the neurons of the hidden layer and then fed to the neurons of the output layer. (Illustration of motor neuron from Life ART Collection Images 1989-2001 by Lippincott Williams Wilkins used by permission from SmartDraw.com.)...

In another example, a neural network was applied successfully to the prediction of conversion and yields in the decomposition of NO into N2 and O2 over Cu/ ZSM-5 catalysts [42]. This shows that artificial neural networks arc able to describe a complex catalytic system quite well if an appropriate numerical representation is found for the input and output data. The problem in their application may be the availability of a representative set of experimental data for learning, as well as the interpretation of the weights obtained for neuron interconnections which do not enable direct derivation of guidelines for the optimization of a catalytic system. 

The field of artificial neural networks is a new and rapidly growing field and, as such, is susceptible to problems with naming conventions. In this book, a perceptron is defined as a two-layer network of simple artificial neurons of the type described in Chapter 2. The term perceptron is sometimes used in the literature to refer to the artificial neurons themselves. Perceptrons have been around for decades (McCulloch Pitts, 1943) and were the basis of much theoretical and practical work, especially in the 1960s. Rosenblatt coined the term perceptron (Rosenblatt, 1958). Unfortunately little work was done with perceptrons for quite some time after it was realized that they could be used for only a restricted range of linearly separable problems (Minsky Papert, 1969). 

---