Principal component analysis unsupervised

Multiple linear regression is strictly a parametric supervised learning technique. A parametric technique is one which assumes that the variables conform to some distribution (often the Gaussian distribution) the properties of the distribution are assumed in the underlying statistical method. A non-parametric technique does not rely upon the assumption of any particular distribution. A supervised learning method is one which uses information about the dependent variable to derive the model. An unsupervised learning method does not. Thus cluster analysis, principal components analysis and factor analysis are all examples of unsupervised learning techniques. 

Two examples of unsupervised classical pattern recognition methods are hierarchical cluster analysis (HCA) and principal components analysis (PCA). Unsupervised methods attempt to discover natural clusters within data sets. Both HCA and PCA cluster data. 

Principal component analysis (PCA) can be considered as the mother of all methods in multivariate data analysis. The aim of PCA is dimension reduction and PCA is the most frequently applied method for computing linear latent variables (components). PCA can be seen as a method to compute a new coordinate system formed by the latent variables, which is orthogonal, and where only the most informative dimensions are used. Latent variables from PCA optimally represent the distances between the objects in the high-dimensional variable space—remember, the distance of objects is considered as an inverse similarity of the objects. PCA considers all variables and accommodates the total data structure it is a method for exploratory data analysis (unsupervised learning) and can be applied to practical any A-matrix no y-data (properties) are considered and therefore not necessary. 

Methods for unsupervised learning invariably aim at compression or the extraction of information present in the data. Most prominent in this field are clustering methods [140], self-organizing networks [141], any type of dimension reduction (e.g., principal component analysis [142]), or the task of data compression itself. All of the above may be useful to interpret and potentially to visualize the data. 

Unsupervised learning methods - cluster analysis - display methods - nonlinear mapping (NLM) - minimal spanning tree (MST) - principal components analysis (PCA) Finding structures/similarities (groups, classes) in the data... 

The answers to these questions will usually be given by so-called unsupervised learning or unsupervised pattern recognition methods. These methods may also be called grouping methods or automatic classification methods because they search for classes of similar objects (see cluster analysis) or classes of similar features (see correlation analysis, principal components analysis, factor analysis). 

Unsupervised multivariate statistical methods [CA, principal components analysis, Kohonen s self-organizing maps (SOMs), nonlinear mapping, etc.], which perform spontaneous data analysis without the need for special training (learning), levels of knowledge, or preliminary conditions. 

These various chemometrics methods are used in those works, according to the aim of the studies. Generally speaking, the chemometrics methods can be divided into two types unsupervised and supervised methods(Mariey et al., 2001). The objective of unsupervised methods is to extrapolate the odor fingerprinting data without a prior knowledge about the bacteria studied. Principal component analysis (PCA) and Hierarchical cluster analysis (HCA) are major examples of unsupervised methods. Supervised methods, on the other hand, require prior knowledge of the sample identity. With a set of well-characterized samples, a model can be trained so that it can predict the identity of unknown samples. Discriminant analysis (DA) and artificial neural network (ANN) analysis are major examples of supervised methods. 

We haveemployed a variety of unsupervised and supervised pattern recognition methods such as principal component analysis, cluster analysis, k-nearest neighbour method, linear discriminant analysis, and logistic regression analysis, to study such reactivity spaces. We have published a more detailed description of these investigations. As a result of this, functions could be developed that use the values of the chemical effects calculated by the methods mentioned in this paper. These functions allow the calculation of the reactivity of each individual bond of a molecule. 

In this chapter, we will show altered composition of metabolites in the cancerous tissue revealed by IMS, with both manual data processing and statistic data management. In particular, as a statistical strategy, an unsupervised multivariate data analysis technique that enables us to sort the data sets without any reference information is described. A major method that is related to IMS, namely principal component analysis (PCA), will be described in detail. 

Figure 3.41 shows the result of imaging mass spectrometry-principal component analysis (IMS-PCA) for the colon cancer tissue. In this case, this unsupervised analysis revealed that the largest spectral difference (i.e., the largest difference in metabolite composition) was observed between the normal and the other tissue areas (i.e., normal vs. stroma/cancer area), and the second largest difference was observed between the stroma and normal/cancer area. The overall interpretation of PCA was shown in Table 3.6. 

Principal component analysis (PCA), as described in Chapter 4, is an unsupervised learning method which aims to identify principal components, combinations of variables, which best characterize a data set. Best here means in terms of the information content of the components (variance) and that they are orthogonal to one another. Each principal component (PC) is a linear combination of the original variables as shown in eqn (4.1) and repeated below... 

---