Navigating the Lewis Optimal Control Solution Manual
The Lewis textbook on optimal control is one of those books that shows up on every graduate syllabus. It covers Pontryagin's minimum principle, Riccati equations, and dynamic programming in a way that assumes you already know how to work your way through dense mathematical derivations. The solution manual exists because students get stuck, often at the same points, and need to verify their work or find where they went wrong. The manual walks through chapter-by-chapter problem sets from Lewis's textbook. These aren't trivial exercises. You will see problems involving continuous-time LQR design, shooting methods for two-point boundary value problems, and discrete-time optimal control formulations. Each solution shows the setup, the necessary conditions, and the final result. The level of detail varies depending on which edition you are working with. I remember spending about forty-five minutes on a single problem involving a singular arc in Chapter 5 because I kept second-guessing my transversality condition. The solution manual entry for that problem made it immediately obvious where my boundary condition was wrong. That kind of targeted feedback is what makes the manual useful rather than frustrating.
How to Use the Manual Effectively
Work the problem yourself first. Write down your formulation, set up your Hamiltonian, derive your necessary conditions. Only then look at the manual. If you skip straight to the answer, you lose the debugging process that actually builds your understanding. The manual works best as a verification tool, not as a shortcut around the work. Pay close attention to the notation differences. Lewis uses slightly different conventions than some other textbooks. His Hamiltonian formulation might include costates differently than what you saw in your prerequisite course. The solution manual sticks to his notation consistently, which actually helps you map between different sources if you need to cross-reference. One thing the manual does not do well is explain the intuition behind why a particular approach was chosen. When you see a solution using a direct collocation method instead of an indirect shooting method, the manual presents the direct method without much discussion of alternatives. That gap is normal. Supplement your reading with lecture notes or other references when the manual feels too terse on the reasoning side.
Common Problem Areas and Workarounds
The Riccati equation problems in the later chapters tend to trip people up. Specifically, the continuous-time algebraic Riccati equation (CARE) solutions assume certain regularity conditions that the textbook states but does not always verify explicitly in each problem. If your numerical solver is failing to converge on a CARE, check whether your weighting matrices satisfy the required definiteness properties before assuming the manual's answer is wrong. Another edge case involves problems with state constraints. The Lewis treatment touches on these but the solution manual sometimes glosses over the regularization steps needed when a constraint becomes active at a specific time. I encountered this in a problem where the optimal control switched exactly at t equals one, and the manual's solution did not fully resolve the switch point. What worked for me was setting up a small bisection search around the switching time to pin down the exact value. The manual gets the general structure right but occasionally leaves the fine numerical details to you.
Get the Full Details

Where to Find the Manual
Legitimate copies are typically available through academic channels. Check with your university library first. Some institutions hold examination copies or instructor materials that include the full solution manual. Online textbook retailers sometimes list it separately under the ISBN for the instructor edition. Be cautious with sites offering free PDF downloads, as those are generally unauthorized and may contain errors or outdated material from older editions. If you are an instructor, the publisher provides the manual directly upon verification of your course adoption. The process usually takes about a week. Students who have been recommended the textbook should be able to locate the manual through legitimate academic resources rather than relying on questionable download sites. The manual is a reference tool, not a substitute for working through the derivations yourself. Use it the way you would use any other academic resource: carefully, selectively, and with the understanding that the real learning happens during the struggle with the problem before you check the answer.