Kalman problem

In this figure the next definitions are used A - projection operator, B - pseudo-inverse operator for the image parameters a,( ), C - empirical posterior restoration of the FDD function w(a, ), E - optimal estimator. The projection operator A is non-observable due to the Kalman criteria [10] which is the main singularity for this problem. This leads to use the two step estimation procedure. First, the pseudo-inverse operator B has to be found among the regularization techniques in the class of linear filters. In the second step the optimal estimation d (n) for the pseudo-inverse image parameters d,(n) has to be done in the presence of transformed noise j(n). 

Other chemometrics methods to improve caUbration have been advanced. The method of partial least squares has been usehil in multicomponent cahbration (48—51). In this approach the concentrations are related to latent variables in the block of observed instmment responses. Thus PLS regression can solve the colinearity problem and provide all of the advantages discussed earlier. Principal components analysis coupled with multiple regression, often called Principal Component Regression (PCR), is another cahbration approach that has been compared and contrasted to PLS (52—54). Cahbration problems can also be approached using the Kalman filter as discussed (43). 

At the first eonferenee of the International Federation of Automatie Control (IFAC), Kalman (1960) introdueed the dual eoneept of eontrollability and observability. At the same time Kalman demonstrated that when the system dynamie equations are linear and the performanee eriterion is quadratie (LQ eontrol), then the mathematieal problem has an explieit solution whieh provides an optimal eontrol law. Also Kalman and Buey (1961) developed the idea of an optimal filter (Kalman filter) whieh, when eombined with an optimal eontroller, produeed linear-quadratie-Gaussian (LQG) eontrol. 

The Kalman filter single variable estimation problem... 

This tutorial uses the MATLAB Control System Toolbox for linear quadratie regulator, linear quadratie estimator (Kalman filter) and linear quadratie Gaussian eontrol system design. The tutorial also employs the Robust Control Toolbox for multivariable robust eontrol system design. Problems in Chapter 9 are used as design examples. 

Historically, treatment of measurement noise has been addressed through two distinct avenues. For steady-state data and processes, Kuehn and Davidson (1961) presented the seminal paper describing the data reconciliation problem based on least squares optimization. For dynamic data and processes, Kalman filtering (Gelb, 1974) has been successfully used to recursively smooth measurement data and estimate parameters. Both techniques were developed for linear systems and weighted least squares objective functions. 

Extended Kalman filtering has been a popular method used in the literature to solve the dynamic data reconciliation problem (Muske and Edgar, 1998). As an alternative, the nonlinear dynamic data reconciliation problem with a weighted least squares objective function can be expressed as a moving horizon problem (Liebman et al., 1992), similar to that used for model predictive control discussed earlier. 

R. E. Kalman, A new approach to linear filtering and prediction problems, Transactions of the ASME-Journal of Basic Engineering, Vol. 82, pp. 35-45,1960,... 

The preceding section discusses the mathematical formulation of the problem under consideration and the general conditions for redundancy and estimability. Now, we are ready to analyze the decomposition of the general estimation problem. The division of linear dynamic systems into their observable and unobservable parts was first suggested by Kalman (1960). The same type of arguments can be extended here to decompose a system considered to be at steady-state conditions. 

Equations (8.11) and (8.12) are approximate expressions for propagating the estimate and the error covariance, and in the literature they are referred to as the extended Kalman filter (EKF) propagation equations (Jaswinski, 1970). Other methods for dealing with the same problem are discussed in Gelb (1974) and Anderson and Moore (1979). 

It should be noted that the solution of the minimization problem simplifies to the updating step of a Kalman filter. In fact, if instead of applying the matrix inversion lemma to Eq. (8.19) to produce Eq. (8.20), the inversion is performed on the estimate equation (8.18), the well-known form of the Kaman filter equations is obtained. 

The solution of the minimization problem again simplifies to updating steps of a static Kalman filter. For the linear case, matrices A and C do not depend on x and the covariance matrix of error can be calculated in advance, without having actual measurements. When the problem is nonlinear, these matrices depend on the last available estimate of the state vector, and we have the extended Kalman filter. 

In this chapter different aspects of data processing and reconciliation in a dynamic environment were briefly discussed. Application of the least square formulation in a recursive way was shown to lead to the classical Kalman filter formulation. A simpler situation, assuming quasi-steady-state behavior of the process, allows application of these ideas to practical problems, without the need of a complete dynamic model of the process. 

The problem of state-parameter estimation in dynamic systems is considered in terms of decoupling the estimation procedure. By using the extended Kalman filter (EKF) approach, the state-parameter estimation problem is defined and a decoupling procedure developed that has several advantages over the classical approach. 

According to the previous section, in order to deal with the state-parameter estimation problem we have to solve a nonlinear set of filtering equations. The extended Kalman filter leads to the following equations (Ursin, 1980) ... 

The optimal filtering problem (the Kalman-Bucy filter) can be solved independent of the optimal control for the LQP and provides a means for estimating unmeasured state variables which may be corrupted by process and instrument noise. 

When a model state is described by nonlinear equations, the extended Kalman filter has been applied using the well-known Kalman filter equations for the linearization of equations. If the state vector is enlarged with the parameter vector (P]j is used because it corresponds to the discrete version of the state model) and if it is considered to be constant or varying slowly, then it is possible to transform the problem of parameters estimation into a problem of state estimation. The P i i = P]j + njj with n]j white noise correction represents the model suggested for... 

The Kalman filter problem. Considering the relations (3.258) and (3.259)) we can write the following discrete-time system ... 

These two relations are the basis for other important developments of the Kalman filter equations. Concerning the problem considered above, the calculation of the minimum mean square error can be carried out either ... 

The Kalman Filter Equations are here obtained from the formulation of the Kalman filter with the purpose of finding a recursive estimation procedure for the solution of a problem (estimation of state vector). Before detailing the procedure, we have to introduce other new notations. The minimum square estimate of for the given observations Yj= [yo>yi --yil defined by xy. Furthermore represents the error covariance associated with... 

The example analyzed here is one of the simplest problems because it is two-dimensional with respect to the vectors state. The example illustrates the Kalman tracking for a system model, which is controllable and observable. To this aim, we use the following system model and prior statistics ... 

In Chapter 3 the basic equations for reactions and reactors are set up the objective function needed to define a realistic optimal problem is discussed in Chapter 4. Subsequently, it is natural to consider separately the main types of chemical reactors and their associated problems. In Chapter 8 three problems with a stochastic element in them are described. Chapter 9 concerns itself with the optimal operation of existing reactors which may be regarded as partial designs in which only some of the variables can be optimally chosen. Some recent advances in optimal control, which, however, lie outside our present considerations, are to be found in the paper by Kalman, Lapidus, and Shapiro (1959) and in that of Rudd, Aris, and Amundson (1961). 

Although online optimization allows constraints on estimates as part of the problem formulation, formulating a state estimation problem with inequality constraints prevents recursive solutions as Kalman filter, and therefore, the estimation problem grows with time as more measurements become available. The computational complexity scales at least linearly with time, and consequently, the online solution is impractical due to the... 

---