Module for the Chebyshev Approximation Polynomial

Check out the new Numerical Analysis Projects page.

 

Background for the Chebyshev approximation polynomial.  We now turn our attention to polynomial interpolation for  f(x)  over  [-1,1]  based on the nodes  [Graphics:Images/ChebyshevPolyMod_gr_1.gif].  Both the Lagrange and Newton polynomials satisfy  

    
[Graphics:Images/ChebyshevPolyMod_gr_2.gif],  

where the remainder term  [Graphics:Images/ChebyshevPolyMod_gr_3.gif]  has the form

    
[Graphics:Images/ChebyshevPolyMod_gr_4.gif].  

and  [Graphics:Images/ChebyshevPolyMod_gr_5.gif]  is the polynomial of degree  [Graphics:Images/ChebyshevPolyMod_gr_6.gif]  given by    

    
[Graphics:Images/ChebyshevPolyMod_gr_7.gif]

Using the relationship

    
[Graphics:Images/ChebyshevPolyMod_gr_8.gif] [Graphics:Images/ChebyshevPolyMod_gr_9.gif][Graphics:Images/ChebyshevPolyMod_gr_10.gif]

our task is to determine how to select the set of nodes  [Graphics:Images/ChebyshevPolyMod_gr_11.gif]  that minimizes  [Graphics:Images/ChebyshevPolyMod_gr_12.gif].  Research investigating the minimum error in polynomial interpolation is attributed to the Russian mathematician Pafnuty Lvovich Chebyshev (1821-1894).

Table of Chebyshev Polynomials.  
    

[Graphics:Images/ChebyshevPolyMod_gr_13.gif]

=

[Graphics:Images/ChebyshevPolyMod_gr_14.gif]

[Graphics:Images/ChebyshevPolyMod_gr_15.gif]

=

[Graphics:Images/ChebyshevPolyMod_gr_16.gif]

[Graphics:Images/ChebyshevPolyMod_gr_17.gif]

=

[Graphics:Images/ChebyshevPolyMod_gr_18.gif]

[Graphics:Images/ChebyshevPolyMod_gr_19.gif]

=

[Graphics:Images/ChebyshevPolyMod_gr_20.gif]

[Graphics:Images/ChebyshevPolyMod_gr_21.gif]

=

[Graphics:Images/ChebyshevPolyMod_gr_22.gif]

[Graphics:Images/ChebyshevPolyMod_gr_23.gif]

=

[Graphics:Images/ChebyshevPolyMod_gr_24.gif]

[Graphics:Images/ChebyshevPolyMod_gr_25.gif]

=

[Graphics:Images/ChebyshevPolyMod_gr_26.gif]

[Graphics:Images/ChebyshevPolyMod_gr_27.gif]

=

[Graphics:Images/ChebyshevPolyMod_gr_28.gif]

[Graphics:Images/ChebyshevPolyMod_gr_29.gif]

  

[Graphics:Images/ChebyshevPolyMod_gr_30.gif]

  

 

Recursive Relationship.  The Chebyshev polynomials can be generated recursively in the following way.  First, set

        [Graphics:Images/ChebyshevPolyMod_gr_31.gif]  

  and use the recurrence relation

        [Graphics:Images/ChebyshevPolyMod_gr_32.gif].  

Exploration 1.

 

Relation to trigonometric functions.

The signal property of Chebyshev polynomials is the trigonometric representation on [-1,1].

Consider the following expansion using the Mathematica command "FunctionExpand."

 

[Graphics:Images/ChebyshevPolyMod_gr_51.gif]
[Graphics:Images/ChebyshevPolyMod_gr_52.gif] [Graphics:Images/ChebyshevPolyMod_gr_53.gif]

Exploration 2.

 

These celebrated Chebyshev polynomials are readily available in Mathematica and called under the reserved name "ChebyshevT[n,x]."  

 

[Graphics:Images/ChebyshevPolyMod_gr_82.gif]

[Graphics:Images/ChebyshevPolyMod_gr_83.gif]

[Graphics:Images/ChebyshevPolyMod_gr_84.gif]

[Graphics:Images/ChebyshevPolyMod_gr_85.gif]

[Graphics:Images/ChebyshevPolyMod_gr_86.gif]

[Graphics:Images/ChebyshevPolyMod_gr_87.gif]

[Graphics:Images/ChebyshevPolyMod_gr_88.gif]

Roots of the Chebyshev polynomials

The roots of  [Graphics:Images/ChebyshevPolyMod_gr_89.gif]  are  [Graphics:Images/ChebyshevPolyMod_gr_90.gif].  These will be the nodes for polynomial approximation of degree n.  

Exploration 3.

 

The Minimax Problem

    An upper bound for the absolute value of the remainder term, [Graphics:Images/ChebyshevPolyMod_gr_104.gif],  is the product of  [Graphics:Images/ChebyshevPolyMod_gr_105.gif]  and   [Graphics:Images/ChebyshevPolyMod_gr_106.gif].  To minimize the factor  [Graphics:Images/ChebyshevPolyMod_gr_107.gif],  Chebyshev discovered that  [Graphics:Images/ChebyshevPolyMod_gr_108.gif]  must be chosen so that  [Graphics:Images/ChebyshevPolyMod_gr_109.gif], which is stated in the following result.   

Theorem  (Minimax Property).   Assume that  n  is fixed.  Among all possible choices for  Q(x)  and thus among all possible choices for the distinct nodes  [Graphics:Images/ChebyshevPolyMod_gr_110.gif]  in  [-1,1],  the polynomial  [Graphics:Images/ChebyshevPolyMod_gr_111.gif]  is the unique choice which has the property

            
[Graphics:Images/ChebyshevPolyMod_gr_112.gif] <=  [Graphics:Images/ChebyshevPolyMod_gr_113.gif]

Moreover,

            
[Graphics:Images/ChebyshevPolyMod_gr_114.gif].  

Proof.  The proof is found in advanced numerical analysis books.  

Exploration for the theorem.  Construct Q(x) of degree n using the n+1 Chebyshev nodes and compare it to [Graphics:Images/ChebyshevPolyMod_gr_115.gif].

Exploration 4.

 

Rule of Thumb. The "best a priori choice" of interpolation nodes for the interval [-1,1] are the n+1 nodes that are zeros of the Chebyshev polynomial  [Graphics:Images/ChebyshevPolyMod_gr_147.gif].  

The Affect of Nodes  

Here is a visual analysis of equally spaced nodes verses Chebyshev nodes on [-1,1], and their affect on the magnitude of Q(x) in the remainder term  [Graphics:Images/ChebyshevPolyMod_gr_148.gif].  

[Graphics:Images/ChebyshevPolyMod_gr_149.gif]
[Graphics:Images/ChebyshevPolyMod_gr_150.gif]

[Graphics:Images/ChebyshevPolyMod_gr_151.gif]

[Graphics:Images/ChebyshevPolyMod_gr_152.gif]

[Graphics:Images/ChebyshevPolyMod_gr_153.gif]



[Graphics:Images/ChebyshevPolyMod_gr_154.gif]

[Graphics:Images/ChebyshevPolyMod_gr_155.gif]

[Graphics:Images/ChebyshevPolyMod_gr_156.gif]

[Graphics:Images/ChebyshevPolyMod_gr_157.gif]



[Graphics:Images/ChebyshevPolyMod_gr_158.gif]

[Graphics:Images/ChebyshevPolyMod_gr_159.gif]

[Graphics:Images/ChebyshevPolyMod_gr_160.gif]

[Graphics:Images/ChebyshevPolyMod_gr_161.gif]

Observation.  The magnitude of Q(x) is less when the Chebyshev nodes are used and larger when equally spaced notes are used.  This becomes more pronounced when the degree is larger.

[Graphics:Images/ChebyshevPolyMod_gr_162.gif]

[Graphics:Images/ChebyshevPolyMod_gr_163.gif]

[Graphics:Images/ChebyshevPolyMod_gr_164.gif]

[Graphics:Images/ChebyshevPolyMod_gr_165.gif]



[Graphics:Images/ChebyshevPolyMod_gr_166.gif]

[Graphics:Images/ChebyshevPolyMod_gr_167.gif]

[Graphics:Images/ChebyshevPolyMod_gr_168.gif]

[Graphics:Images/ChebyshevPolyMod_gr_169.gif]


Are you convinced that using the Chebyshev nodes on [-1,1], will decrease the magnitude of the term Q(x) in the remainder term  [Graphics:Images/ChebyshevPolyMod_gr_170.gif]?  

Transforming the Interval for Interpolation

    Sometimes it is necessary to take a problem stated on an interval  [a,b]  and reformulate the problem on the interval  [c,d]  where the solution is known.  If the approximation  [Graphics:Images/ChebyshevPolyMod_gr_171.gif]  to  [Graphics:Images/ChebyshevPolyMod_gr_172.gif]  is to be obtained on the interval  [a,b],  then we change the variable so that the problem is reformulated on  [-1,1]:

    [Graphics:Images/ChebyshevPolyMod_gr_173.gif]  or  [Graphics:Images/ChebyshevPolyMod_gr_174.gif],

where  [Graphics:Images/ChebyshevPolyMod_gr_175.gif].  The required Chebyshev nodes of  [Graphics:Images/ChebyshevPolyMod_gr_176.gif]  on  [-1,1]  are

    [Graphics:Images/ChebyshevPolyMod_gr_177.gif],  

and the interpolating nodes  [Graphics:Images/ChebyshevPolyMod_gr_178.gif]  on  [a,b]  are obtained using the change of variable  [Graphics:Images/ChebyshevPolyMod_gr_179.gif]  for  [Graphics:Images/ChebyshevPolyMod_gr_180.gif].  

Theorem (Lagrange-Chebyshev Approximation).  Assume that  [Graphics:Images/ChebyshevPolyMod_gr_181.gif]  is the Lagrange polynomial that is based on the Chebyshev interpolating nodes  [Graphics:Images/ChebyshevPolyMod_gr_182.gif]  on  [a,b]  mentioned above.  If  [Graphics:Images/ChebyshevPolyMod_gr_183.gif]  then

    
[Graphics:Images/ChebyshevPolyMod_gr_184.gif]  

holds for all
  [Graphics:Images/ChebyshevPolyMod_gr_185.gif].   

Algorithm (Lagrange-Chebyshev Approximation).  The Chebyshev approximation polynomial  [Graphics:Images/ChebyshevPolyMod_gr_186.gif]  of  degree  [Graphics:Images/ChebyshevPolyMod_gr_187.gif]  for  f(x)  over  [-1,1]  can be written as a sum of  [Graphics:Images/ChebyshevPolyMod_gr_188.gif]:  

    [Graphics:Images/ChebyshevPolyMod_gr_189.gif].  

The coefficients  [Graphics:Images/ChebyshevPolyMod_gr_190.gif]  are computed with the formulas  

    
[Graphics:Images/ChebyshevPolyMod_gr_191.gif][Graphics:Images/ChebyshevPolyMod_gr_192.gif],  
and  

    [Graphics:Images/ChebyshevPolyMod_gr_193.gif][Graphics:Images/ChebyshevPolyMod_gr_194.gif],  

for  [Graphics:Images/ChebyshevPolyMod_gr_195.gif]  where  [Graphics:Images/ChebyshevPolyMod_gr_196.gif] for  [Graphics:Images/ChebyshevPolyMod_gr_197.gif].  

 

Animations (Chebyshev Polynomials  Chebyshev Polynomials).  Internet hyperlinks to animations.

 

Mathematica Subroutine (Chebyshev Approximation).  
The first subroutine "Chebyshev" uses recursion to construct the Chebyshev Approximation Polynomial.  

[Graphics:Images/ChebyshevPolyMod_gr_198.gif]

The following subroutine "ChebyshevPoly" version uses Mathematica's built-in functions to construct the Chebyshev approximation polynomial.  
In the construction, vector operations are used to assist the computations, since, similar terms occur in the summation for each of the coefficients.
Both give the same results.

Mathematica Subroutine (Chebyshev Approximation).  
The following subroutine "ChebyshevPoly" version uses Mathematica's built-in functions to construct the Chebyshev approximation polynomial.  
In the construction, vector operations are used to assist the computations, since, similar terms occur in the summation for each of the coefficients.
Both give the same results.

[Graphics:Images/ChebyshevPolyMod_gr_199.gif]

First, generate some Chebyshev polynomials with Mathematica's built in function.

[Graphics:Images/ChebyshevPolyMod_gr_200.gif]
[Graphics:Images/ChebyshevPolyMod_gr_201.gif] [Graphics:Images/ChebyshevPolyMod_gr_202.gif]
[Graphics:Images/ChebyshevPolyMod_gr_203.gif]

Example. Construct three interpolating polynomials of degree  n=1  for the function  [Graphics:Images/ChebyshevPolyMod_gr_204.gif]  over  [Graphics:Images/ChebyshevPolyMod_gr_205.gif].  
Use the following sets of interpolation nodes.
(a).  Use the nodes  [Graphics:Images/ChebyshevPolyMod_gr_206.gif].  
(b).  Use the nodes  [Graphics:Images/ChebyshevPolyMod_gr_207.gif].  
(c).  Use the Chebyshev nodes  [Graphics:Images/ChebyshevPolyMod_gr_208.gif].
Solution.

Example 1.  Investigate a Chebyshev polynomial for  [Graphics:Images/ChebyshevPolyMod_gr_263.gif].
Solution 1.

Example 2.   Form several Chebyshev polynomials of degree  n = 1,2, 3, 4, and 5  for the function  [Graphics:Images/ChebyshevPolyMod_gr_281.gif]  over the interval  [Graphics:Images/ChebyshevPolyMod_gr_282.gif]  using Chebyshev's abscissas.
Solution 2.

 

Example 3.  Error Analysis.  Investigate the error for the Chebyshev polynomial approximations in Example 2.
Solution 3.

 

Example 4.  What is the maximum over the interval  [0, 1]  for each of the quantities, where  [Graphics:Images/ChebyshevPolyMod_gr_384.gif]  is the Chebyshev polynomial.
4 (a).  Find  [Graphics:Images/ChebyshevPolyMod_gr_385.gif].  
4 (b).  Find  [Graphics:Images/ChebyshevPolyMod_gr_386.gif].  
4 (c).  Find  [Graphics:Images/ChebyshevPolyMod_gr_387.gif].  
4 (d).  Find  [Graphics:Images/ChebyshevPolyMod_gr_388.gif].  
4 (e).  Find  [Graphics:Images/ChebyshevPolyMod_gr_389.gif].  
4 (f).  Compare the result with the error bounds for the Lagrange polynomial based on equally spaced points.
Solution 4.

 

 

Old Lab Project (Chebyshev Polynomials  Chebyshev Polynomials).  
Internet hyperlinks to an old lab project.  

 

Research Experience for Undergraduates

Chebyshev Approximation Polynomial  Chebyshev Approximation Polynomial  
Internet hyperlinks to web sites and a bibliography of articles.  

   

Downloads (Chebyshev Approximation Polynomial Chebyshev Approximation Polynomial).  
Download this Mathematica notebook.  

 

 

 

 

 

 

 

 

 

 

(c) John H. Mathews 2003