Artificial neural networks multilayer perceptron network

Evaluation of air pollution level by means of artificial neural network -multilayer perceptron... 

Figure6.25 Schematicdrawingofan artificial neural network with a multilayer perceptron topology, showing the pathways from the input Xj to the output y , and the visible and hidden node layers.

In the previous chapter a simple two-layer artificial neural network was illustrated. Such two-layer, feed-forward networks have an interesting history and are commonly called perceptrons. Similar networks with more than two layers are called multilayer perceptrons, often abbreviated as MLPs. In this chapter the development of perceptrons is sketched with a discussion of particular applications and limitations. Multilayer perceptron concepts are developed applications, limitations and extensions to other kinds of networks are discussed. 

The artificial neural network (ANN) based prediction model utilized in the present study is the multilayer perceptrons (MLPs). It is adopted as the benchmark to compare with the time-varying statistical models since it has been shown that the MLP architecture could approximate... 

Gardner, M. W. and Dorhng, S. R. Artificial neural networks (the multilays perceptron) - a review of apphca-tions in the atmosphere sciences. Atmospheric Environment 32(14) (1998), 2627-2636. 

The framework of presented intelligent multi-sensor system is reflected by its data processing flow as illustrated in Fig. 3. Diversified sensors in field and sophisticated algorithms make the system scalable and adaptive to different driving profiles and scenarios. Data sets of complementary sensors are synchronized on the same time base before being conveyed to feature computation components. Based on the outcome of feature computation selected data sets are fused on the Mature level to construct input vectors for pattern classification so as to detect driver drowsiness. The classifier being used in this work is built upon Artificial Neural Network (ANN) or, more particularly. Multilayer Perceptrons (MLP) with supervised training procedure. 

Artificial neural networks (ANNs) are a non-linear function mapping technique that was initially developed to imitate the brain from both a structural and computational perspective. Its parallel architecture is primarily responsible for its computational power. The multilayer perceptron network architecture is probably the most popular and is used here. 

Boccorh RK, Paterson A (2002) An artificial neural network model for predicting flavour intensity in blackcurrant concentrates. Food Qual Prefer 13(2) 117-128 Ceballos-Magana SG, de Pablos F, Jurado JM, Martin MJ, Alcazar A, Muniz-Valencia R, Izquierdo-Homillos R (2013) Characterisation of tequila according to their major volatile composition using multilayer perceptron neural networks. Food Chem 136(3) 1309-1315... 

Keywords Artificial neural network, support vector machines, mathematical modeling, multilayer perceptron, hybrid modeling methodologies, pharmaceutical applications... 

For further information about basic concepts pertaining to artificial neural networks in general, and to multilayer perceptrons in particular, the reader is referred to specialised monographs such as White (1992), Hagan et al. (1996), Mehrotra et al. (1996) and Haykin (1999). An overview of traditional kinds of ANN applications in chemistry can most easily be obtained from the books by Zupan and Gasteiger (1993, 1999), and from the survey papers by Meissen et al. (1994), Smits et al. (1994) and Henson (1998). 

Artificial neural networks (ANNs) are good at classifying non-linearly separable data. There are at least 30 different types of ANNs, including multilayer perceptron, radial basis functions, self-organizing maps, adaptive resonance theory networks and time-delay neural netwoiks. Indeed, the majority of ATI applications discussed later employ ANNs - most commonly, MLP (multilayer perceptron), RBF (radial basis function) or SOM (self-organizing map). A detailed treatise of neural networks for ATI is beyond the scope of this chapter and the reader is referred to the excellent introduction to ANNs in Haykin (1994) and neural networks applied to pattern recognition in Looney (1997) and Bishop (2(X)0). Classifiers for practical ATI systems are also described in other chapters of this volume. 

In fact, this was done for the PCA version of DAISY. Each species had its own PCA-based classifier the unknown was deemed to belong to that species to which it had the highest affinity. A full description of this version of DAISY is given in Weeks et al. (1997). This inherent non-scalabihty is also a feature of back-propagation artificial neural networks (ANNs) - for example, multilayer perceptrons. 

A basic information about Artificial Neural Networks (ANNs) and their applications was introduced. A special attention was given to description of dynamic processes by mean of ANN. The drying kinetics of agricultural products are presented in the paper. Multilayer Perceptron (MLP) and Radial Basis Function (RBF) network types are proposed for predicting changes of moisture content and temperature of material in during drying in the vibrofluidized bed. Capability of prediction of Artificial Neural Networks is evaluated in feed forward and recurrent structures. 

Fig. 17. Use of a multilayer perceptron-type artificial neural network to analyze an interferometric image of...

Figure 5.3 Simple multilayered perceptron of an artificial neural network...

One of the early problems with multilayer perceptrons was that it was not clear how to train them. The perception training rule doesn t apply directly to networks with hidden layers. Fortunately, Rumelhart and others (Rumelhart et al 1986) devised an intuitive method that quickly became adopted and revolutionized the field of artificial neural networks. The method is called back-propagation because it computes the error term as described above and propagates the error backward through the network so that weights to and from hidden units can be modified in a fashion similar to the delta rule for perceptions. 

The major limitation of the simple perceptron model is that it fails drastically on linearly inseparable pattern recognition problems. For a solution to these cases we must investigate the properties and abilities of multilayer perceptrons and artificial neural networks. 

---