The Mathematics of Nonlinear Programming by Anthony L. Peressini
Nonlinear programming provides an excellent opportunity to explore an interesting variety of pure and solidly applicable mathematics, numerical analysis, and computing. This text develops some of the ideas and techniques involved in the optimization methods using calculus, leading to the study of convexity. This is followed by material on basic numerical methods, least squares, the Karush-Kuhn-Tucker theorem, penalty functions, and Lagrange multipliers. The authors have aimed their presentation at the student who has a working knowledge of matrix algebra and advanced calculus, but has had no previous exposure to optimization.