Easily Overlooked or Hidden

Dynamic programming argues that the maximum, when found, will depend on the initial state U, V, say, F(U, V). If, during an initial period (0, r) 

141 seem to recall a review of one Bellman s books in which the reviewer compared him to the cavalry hero who mounted his horse and galloped off in all directions, but have not been able to locate the reference. 

15 The scaling has been chosen so that the rate expression appears in both equations with unit coefficient. 

There will certainly be a limit to the rate of cooling, so let us write 

16 Bellman s statement of the Principle of Optimality is, An optimal policy has the property that whatever the initial state and initial decision may be, the remaining decisions must constitute an optimal policy with regard to the state resulting from the first decision. In other words If you don t do the best you can with what you happen to have, you ll never do the best you might have done with what you should have had. 

---