Theorem (Newton-Raphson Theorem).  Assume that [Graphics:Images/Newton'sMethodProof_gr_7.gif] and there exists a number [Graphics:Images/Newton'sMethodProof_gr_8.gif], where [Graphics:Images/Newton'sMethodProof_gr_9.gif].  If   [Graphics:Images/Newton'sMethodProof_gr_10.gif], then there exists a [Graphics:Images/Newton'sMethodProof_gr_11.gif] such that the sequence [Graphics:Images/Newton'sMethodProof_gr_12.gif] defined by the iteration  

    [Graphics:Images/Newton'sMethodProof_gr_13.gif]    for    [Graphics:Images/Newton'sMethodProof_gr_14.gif]  

will converge to [Graphics:Images/Newton'sMethodProof_gr_15.gif] for any initial approximation  [Graphics:Images/Newton'sMethodProof_gr_16.gif].  

        

[Graphics:Images/Newton'sMethodProof_gr_17.gif]

Derivation.

Newton's method is based on linear approximation or the Taylor polynomial of degree [Graphics:../Images/Newton'sMethodProof_gr_47.gif] expanded about  [Graphics:../Images/Newton'sMethodProof_gr_48.gif].  

[Graphics:../Images/Newton'sMethodProof_gr_49.gif]
[Graphics:../Images/Newton'sMethodProof_gr_50.gif]

Which means that we have the equation

[Graphics:../Images/Newton'sMethodProof_gr_51.gif]
[Graphics:../Images/Newton'sMethodProof_gr_52.gif]

For this Taylor polynomial, the Lagrange form for the remainder is  [Graphics:../Images/Newton'sMethodProof_gr_53.gif],  and we write  

(1)    [Graphics:../Images/Newton'sMethodProof_gr_54.gif].  

We seek the value  [Graphics:../Images/Newton'sMethodProof_gr_55.gif]  which makes  [Graphics:../Images/Newton'sMethodProof_gr_56.gif].  

Substituting  [Graphics:../Images/Newton'sMethodProof_gr_57.gif]  in equation (1) results in

(2)    [Graphics:../Images/Newton'sMethodProof_gr_58.gif].  

Since the remainder term is for theoretical consideration and not for numerical computation, we must chop it off or truncate the right side of equation (2).  But then it is not an equation, only an approximation.

(3)    [Graphics:../Images/Newton'sMethodProof_gr_59.gif].  

If we wish to "solve for p" it is impossible.  But if we change the [Graphics:../Images/Newton'sMethodProof_gr_60.gif] to [Graphics:../Images/Newton'sMethodProof_gr_61.gif] and change [Graphics:../Images/Newton'sMethodProof_gr_62.gif] to [Graphics:../Images/Newton'sMethodProof_gr_63.gif], then we will have an equation to solve.

(4)    [Graphics:../Images/Newton'sMethodProof_gr_64.gif].  

Can Mathematica be used to solve for [Graphics:../Images/Newton'sMethodProof_gr_65.gif]?  Mathematica's represented the error term for Taylor polynomial as  [Graphics:../Images/Newton'sMethodProof_gr_66.gif].  

[Graphics:../Images/Newton'sMethodProof_gr_67.gif]
[Graphics:../Images/Newton'sMethodProof_gr_68.gif]

We can eliminate [Graphics:../Images/Newton'sMethodProof_gr_69.gif] with the command [Graphics:../Images/Newton'sMethodProof_gr_70.gif].

[Graphics:../Images/Newton'sMethodProof_gr_71.gif]
[Graphics:../Images/Newton'sMethodProof_gr_72.gif]

We can substitute [Graphics:../Images/Newton'sMethodProof_gr_73.gif] for [Graphics:../Images/Newton'sMethodProof_gr_74.gif] with the command [Graphics:../Images/Newton'sMethodProof_gr_75.gif].  

[Graphics:../Images/Newton'sMethodProof_gr_76.gif]
[Graphics:../Images/Newton'sMethodProof_gr_77.gif]

Now we have equation (4) which we can solve for the next iteration  [Graphics:../Images/Newton'sMethodProof_gr_78.gif].  

[Graphics:../Images/Newton'sMethodProof_gr_79.gif]
[Graphics:../Images/Newton'sMethodProof_gr_80.gif]

It would look nicer if we dig out the formula in the two braces.

[Graphics:../Images/Newton'sMethodProof_gr_81.gif]
[Graphics:../Images/Newton'sMethodProof_gr_82.gif]

Expand this solution in its familiar form.

[Graphics:../Images/Newton'sMethodProof_gr_83.gif]
[Graphics:../Images/Newton'sMethodProof_gr_84.gif]

So the next iteration is  [Graphics:../Images/Newton'sMethodProof_gr_85.gif].   

Q. E. D.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(c) John H. Mathews 2004