Theorem (Broyden's Method for n-dimensional Systems).  To solve the non-linear system  [Graphics:Images/BroydenMethodProof_gr_146.gif],  given one initial approximation  [Graphics:Images/BroydenMethodProof_gr_147.gif],  and generating a sequence  [Graphics:Images/BroydenMethodProof_gr_148.gif]  which converges to the solution  [Graphics:Images/BroydenMethodProof_gr_149.gif],  i.e.  [Graphics:Images/BroydenMethodProof_gr_150.gif].  Compute the initial Jacobian matrix  

        
[Graphics:Images/BroydenMethodProof_gr_151.gif].  

Use it to compute the first approximation using Newton's method  

        [Graphics:Images/BroydenMethodProof_gr_152.gif].  

For  [Graphics:Images/BroydenMethodProof_gr_153.gif].  Suppose that  [Graphics:Images/BroydenMethodProof_gr_154.gif]  has been obtained, use the following steps to obtain  [Graphics:Images/BroydenMethodProof_gr_155.gif].  

Step 1.     Evaluate the function  [Graphics:Images/BroydenMethodProof_gr_156.gif].  

Step 2.  Update the approximate Jacobian using  [Graphics:Images/BroydenMethodProof_gr_157.gif],  and  [Graphics:Images/BroydenMethodProof_gr_158.gif]

        [Graphics:Images/BroydenMethodProof_gr_159.gif].   

Step 3.  Compute  [Graphics:Images/BroydenMethodProof_gr_160.gif]  using the Sherman-Morrison formula

        [Graphics:Images/BroydenMethodProof_gr_161.gif]  

Step 4.  Compute the next approximation   

        [Graphics:Images/BroydenMethodProof_gr_162.gif].  

Remark.

As the iteration proceeds,  [Graphics:../Images/BroydenMethodProof_gr_163.gif],  and then

        [Graphics:../Images/BroydenMethodProof_gr_164.gif]
    or
        [Graphics:../Images/BroydenMethodProof_gr_165.gif]

where, for  [Graphics:../Images/BroydenMethodProof_gr_166.gif],  

        [Graphics:../Images/BroydenMethodProof_gr_167.gif],  

        [Graphics:../Images/BroydenMethodProof_gr_168.gif],  

        [Graphics:../Images/BroydenMethodProof_gr_169.gif],  
then
        [Graphics:../Images/BroydenMethodProof_gr_170.gif]
    and
        [Graphics:../Images/BroydenMethodProof_gr_171.gif].  

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(c) John H. Mathews 2005