Module for Numerical Differentiation, Part II

Check out the new Numerical Analysis Projects page.

 

Background. Numerical differentiation formulas can be derived by first constructing the Lagrange interpolating polynomial  [Graphics:Images/RichardsonExtrapMod_gr_1.gif] through three points, differentiating the Lagrange polynomial, and finally evaluating  [Graphics:Images/RichardsonExtrapMod_gr_2.gif]  at the desired point.  The truncation error is be investigated, but round off error from computer arithmetic using computer numbers will be studied in another lab.

Three point rule for [Graphics:Images/RichardsonExtrapMod_gr_3.gif].  The centered formula for  the first derivative, based on three points is  

    [Graphics:Images/RichardsonExtrapMod_gr_4.gif],  

and the error bound is  [Graphics:Images/RichardsonExtrapMod_gr_5.gif]  where  [Graphics:Images/RichardsonExtrapMod_gr_6.gif].  

Five point rule for [Graphics:Images/RichardsonExtrapMod_gr_7.gif].  The centered formula for  the first derivative, based on five points is  

    [Graphics:Images/RichardsonExtrapMod_gr_8.gif].  
    

Big "O" error term for [Graphics:Images/RichardsonExtrapMod_gr_9.gif].  

    [Graphics:Images/RichardsonExtrapMod_gr_10.gif].  

Richardson's Extrapolation.  Richardson's extrapolation relates the five point rule and the three point rule,  [Graphics:Images/RichardsonExtrapMod_gr_11.gif],  that was studied previously.  

    [Graphics:Images/RichardsonExtrapMod_gr_12.gif].  

Enter the three point formula for numerical differentiation.

[Graphics:Images/RichardsonExtrapMod_gr_13.gif]
[Graphics:Images/RichardsonExtrapMod_gr_14.gif]

Enter the function, use  [Graphics:Images/RichardsonExtrapMod_gr_15.gif].

[Graphics:Images/RichardsonExtrapMod_gr_16.gif]

[Graphics:Images/RichardsonExtrapMod_gr_17.gif]

Use the results of Example 2 in the previous module to construct the error bound [Graphics:Images/RichardsonExtrapMod_gr_18.gif].  

[Graphics:Images/RichardsonExtrapMod_gr_19.gif]
[Graphics:Images/RichardsonExtrapMod_gr_20.gif] [Graphics:Images/RichardsonExtrapMod_gr_21.gif] [Graphics:Images/RichardsonExtrapMod_gr_22.gif] [Graphics:Images/RichardsonExtrapMod_gr_23.gif] [Graphics:Images/RichardsonExtrapMod_gr_24.gif] [Graphics:Images/RichardsonExtrapMod_gr_25.gif]

Animations (Numerical Differentiation  Numerical Differentiation).  Internet hyperlinks to animations.

 

Project III.  Investigate the numerical differentiation formulae  [Graphics:Images/RichardsonExtrapMod_gr_26.gif]  and error bound  [Graphics:Images/RichardsonExtrapMod_gr_27.gif]  where  [Graphics:Images/RichardsonExtrapMod_gr_28.gif].   
The truncation error is be investigated, but round off error from computer arithmetic using computer numbers will be studied in another lab.

Enter the five point formula for numerical differentiation.

[Graphics:Images/RichardsonExtrapMod_gr_29.gif]
[Graphics:Images/RichardsonExtrapMod_gr_30.gif]

Enter the function, use  [Graphics:Images/RichardsonExtrapMod_gr_31.gif].

[Graphics:Images/RichardsonExtrapMod_gr_32.gif]

[Graphics:Images/RichardsonExtrapMod_gr_33.gif]

Example 1.  Find the formula for the  [Graphics:Images/RichardsonExtrapMod_gr_34.gif].  
Use  [Graphics:Images/RichardsonExtrapMod_gr_35.gif].

Solution 1.

 

Example 2.  Graph  [Graphics:Images/RichardsonExtrapMod_gr_45.gif].  Find the bound  [Graphics:Images/RichardsonExtrapMod_gr_46.gif].   Look at a graph and estimate the value  [Graphics:Images/RichardsonExtrapMod_gr_47.gif], be sure to take the absolute value if necessary.

Solution 2.

 

Example 3 (a).  Compute numerical approximations for the derivatives [Graphics:Images/RichardsonExtrapMod_gr_58.gif], using step sizes [Graphics:Images/RichardsonExtrapMod_gr_59.gif].  
3 (b).  Plot the numerical approximation [Graphics:Images/RichardsonExtrapMod_gr_60.gif] over the interval [Graphics:Images/RichardsonExtrapMod_gr_61.gif].  Compare it with the graph of [Graphics:Images/RichardsonExtrapMod_gr_62.gif] over the interval [Graphics:Images/RichardsonExtrapMod_gr_63.gif].  

Solution 3.

 

Example 4.  Plot the absolute error  [Graphics:Images/RichardsonExtrapMod_gr_92.gif]  over the interval  [Graphics:Images/RichardsonExtrapMod_gr_93.gif], and estimate the maximum absolute error over the interval.
4 (a).  Compute the error bound  [Graphics:Images/RichardsonExtrapMod_gr_94.gif]  and observe that  [Graphics:Images/RichardsonExtrapMod_gr_95.gif]  over  [Graphics:Images/RichardsonExtrapMod_gr_96.gif].  

Solution 4.

 

Example 5.  Investigate the behavior of  [Graphics:Images/RichardsonExtrapMod_gr_114.gif].  If the step size is reduced by a factor of  [Graphics:Images/RichardsonExtrapMod_gr_115.gif]  then the error bound is reduced by  [Graphics:Images/RichardsonExtrapMod_gr_116.gif].  This is the  [Graphics:Images/RichardsonExtrapMod_gr_117.gif]  behavior.

Solution 5.

 

Example 6.  Compare the error bounds for the three point and five point formulas.
6 (a).  Which is smaller [Graphics:Images/RichardsonExtrapMod_gr_136.gif]?  Explain your answer.  
6 (b).  Which is smaller [Graphics:Images/RichardsonExtrapMod_gr_137.gif]?   Explain your answer.  

Solution 6.

 

Project IV.  Investigate Richardson's extrapolation for numerical differentiation.

Example 7.  In general, show that  [Graphics:Images/RichardsonExtrapMod_gr_144.gif].  

Solution 7.

 

Enter the function, use  [Graphics:Images/RichardsonExtrapMod_gr_149.gif].

[Graphics:Images/RichardsonExtrapMod_gr_150.gif]

[Graphics:Images/RichardsonExtrapMod_gr_151.gif]

Example 8.  Find the approximations  [Graphics:Images/RichardsonExtrapMod_gr_152.gif], [Graphics:Images/RichardsonExtrapMod_gr_153.gif]  and then use the extrapolation formula  [Graphics:Images/RichardsonExtrapMod_gr_154.gif].  

Compute  [Graphics:Images/RichardsonExtrapMod_gr_155.gif]  directly.  Finally, compare these numerical approximations for the derivative with  [Graphics:Images/RichardsonExtrapMod_gr_156.gif]

Solution 8.

 

Old Lab Project (Numerical Differentiation  Numerical Differentiation).  

Internet hyperlinks to an old lab project.  

 

Research Experience for Undergraduates

Numerical Differentiation  Numerical Differentiation  

Internet hyperlinks to web sites and a bibliography of articles.  

Richardson Extrapolation  Richardson Extrapolation  

Internet hyperlinks to web sites and a bibliography of articles.  
  

Downloads (Richardson's Extrapolation Richardson's Extrapolation).  

Download this Mathematica notebook.  

 

 

 

 

 

 

 

 

 

 

(c) John H. Mathews 2003