Abstract

Authors

I. Păvăloiu (Tiberiu Popoviciu Institute of Numerical Analysis)

Ion Păvăloiu

Emil Cătinaş (Tiberiu Popoviciu Institute of Numerical Analysis)

Emil Cătinaş

Keywords

?

Paper coordinates

I. Păvăloiu, E. Cătinaş, On the Chebyshev method with numerical applications to the eigenpair problem, Symbolic and Numeric Algorithms for Scientific Computations (SYNASC03), Proceedings of the 5th International Workshop, Timisoara, Romania, October 1-4, D. Petcu, V. Negru, D. Zaharie and T. Jebelean (eds.), pp. 204-210, 2003, ISBN 973-585-785-5.

PDF

About this paper

Journal
Publisher Name
DOI
Print ISSN
Online ISSN

google scholar link

[1] Argyros, I.K., Quadratic equations and applications to Chandrasekhar’s and related equations, Bull. Austral. Math. Soc., 38, pp. 275–292, 1988.

[2] Cătinaş, E., The inexact, inexact perturbed and quasi-Newton methods are equivalent models, Math. Comp., to appear. 74 (2005) no. 249, 291–301.

[3] Cătinaş, E. and I. PăvăloiuOn the Chebyshev method for approximating the eigenvalues of linear operatorsRev. Anal. Numér. Théor. Approx. 25 nos. 1–2, pp. 43–56, 1996.

[4] Cătinaş, E. and I. Păvăloiu, On the Chebyshev method for approximating the eigenvalues of linear operatorsProceedings of International Conference on Approximation and Optimization, Cluj-Napoca, July 29 – August 1, vol. 1, pp. 219–226, 1996.

[5] Cătinaş, E. and I. Păvăloiu, On approximating the eigenvalues and eigenvectors of linear continuous operators, Rev. Anal. Numér. Théor. Approx., 26, nos. 1–2, pp. 19–27, 1997.

[6] Cătinaş, E. and I. Păvăloiu, On some interpolatory iterative methods for the second degree polynomial operators (I), Rev. Anal. Numér. Théor. Approx., 27, pp. 33–45, 1998.

[7] Cătinaş, E. and I. Păvăloiu, On some interpolatory iterative methods for the second degree polynomial operators (II), Rev. Anal. Numér. Théor. Approx., 28, no. 2, pp. 133–143, 1999.

[8] Ciarlet, P.G., Introduction à l’Analyse Numérique Matricielle et à l’Optimisation, Masson, Paris, 1990.

[9] Diaconu, A., On the convergence of an iterative method of Chebyshev type, Rev. Anal. Numér. Théor. Approx., 24, nos. 1–2, pp. 91–102, 1995.

[10] Dongarra, J.J., C.B. Moler and J.H. Wilkinson, Improving the accuracy of the computed eigenvalues and eigenvectors, SIAM J. Numer. Anal., 20, pp. 23–45, 1983.

[11] Grzegórski, S.M., On the scaled Newton method for the symmetric eigenvalue problem, Computing, 45, pp. 277–282, 1990.

[12] Ortega, J.M. and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, New York, 1970.

[13] Păvăloiu, I., Sur les procédés itératifs à un ordre élevé de convergence, Mathematica (Cluj), 12 (35), no. 2, pp. 309–324, 1970.

[14] Păvăloiu, I., Introduction to the Theory of Approximating the Solutions of Equations, Ed. Dacia, Cluj-Napoca, Romania, 1986 (in Romanian).

[15] Păvăloiu, I. and E. Cătinaş, Remarks on some Newton and Chebyshev-type methods for approximating the eigenvalues and eigenvectors of matrices, Computer Science Journal of Moldova, 7, no. 1, pp. 3–17, 1999.

[16] Peters, G. and J.H. Wilkinson, Inverse iteration, ill-conditioned equations and Newton’s method, SIAM Review, 21, no. 3, pp. 339–360, 1979.

[17] Santos, M.C., A note on the Newton iteration for the algebraic eigenvalue problem, SIAM J. Matrix Anal. Appl., 9, no. 4, pp. 561–569, 1988.

[18] Tapia, R.A. and L.D. Whitley, The projected Newton method has order 

1+2

 for the symmetric eigenvalue problem, SIAM J. Numer. Anal., 25, no. 6, pp. 1376–1382, 1988.

[19] Tisseur, F., Newton’s method in floating point arithmetic and iterative refinement of generalized eigenvalue problems, SIAM J. Matrix Anal. Appl., 22, no. 4, pp. 1038–1057, 2001.

[20] Wu K., Y. Saad and A. Stathopoulos, Inexact Newton preconditioning techniques for large symmetric eigenvalue problems, Electronic Transactions on Numerical Analysis, 7, pp. 202–214, 1998.

[21] Yamamoto, T., Error bounds for computed eigenvalues and eigenvectors, Numer. Math., 34, pp. 189–199, 1980.

Paper (preprint) in HTML form

On the Chebyshev method, with numerical applications to the eigenpair problem

On the Chebyshev method, with numerical applications to the eigenpair problem

Presented at 5th Int. Workshop Symbolic and Numeric Algorithms for Scientific Computations (SYNASC03)
Ion Păvăloiu    Emil Cătinaş “T. Popoviciu” Institute of Numerical Analysis,
P.O. Box 68-1,
3400 Cluj-Napoca, ROMANIA
e-mail:{pavaloiu,ecatinas}@ictp.acad.ro
(January 2002)
Abstract

We present a semilocal convergence result for the Chebyshev method applied to a polynomial system of equations of degree 2.

We apply the method in order to approximate the eigenpairs of matrices. The norming function we have proposed in a previous paper of us shows on test matrices better convergence properties of the iterates than the classical norming function.

keywords:
systems of polynomial equations of degree 2, Chebyshev method, eigenvalue/eigenvector problem.
volume: ILissue: 2articletype: RA
\subjclassification

65H10.

1 INTRODUCTION

Let F:XX be a nonlinear mapping, where (X,) is a Banach space, and consider the equation

F(x)=0. (1)

We shall assume that F is a polynomial of degree 2, i.e., it is indefinitely differentiable on X, with F(i)(x)=θi, for all xX and i3, where θi is the i-linear null operator.

In the present paper we shall study the convergence of the Chebyshev method

xk+1=xkF(xk)1F(xk)12F(xk)1F′′(xk)(F(xk)1F(xk))2.

We shall apply this study to the approximation of the eigenpairs of the linear operators in Banach spaces, and we shall consider some numerical examples for some test matrices.

2 A semilocal convergence result

The iterative Chebyshev method for solving equation (1) consists in the successive construction of the elements of the sequence (xk)k0 given by

xk+1=xkΓkF(xk)12ΓkF′′(xk)(ΓkF(xk))2,k=0,1,,x0X, (2)

where Γk=F(xk)1.

Let x0X and δ>0,β>0 be two real numbers. Denote B=Bδ(x0)={xX:xx0δ}. If K=supxBF′′(x), then supxBF(x)F(x0)+Kδ and

supxBF(x)F(x0)+δF(x0)+Kδ2=m0.

Consider the numbers

μ=12K2β4(1+14Km0β2)ν=β(1+12Km0β2) (3)

With the above notations, the following theorem holds:

Theorem 1

If the operator F is three times differentiable with F′′′(x)θ3 for all xB and if, moreover, there exist x0X, δ>0,β>0 such that the following relations hold

  • i.

    the operator F(x) has a bounded inverse for all xB, and

    F(x)1β;
  • ii.

    the numbers μ and ν given by (3) satisfy the relations

    ρ0=μF(x0)<1

    and

    νρ0μ(1ρ0)δ,

then the following properties hold:

  • j.

    the sequence (xk)k0 given by (2) is convergent;

  • jj.

    denoting x=limxxk, then xB and F(x)=θ1;

  • jjj.

    xk+1xkνρ03kμ,k=0,1,;

  • jv.

    xxk νρ03kμ(1ρ03k),k=0,1,.

{proof*}

Denote by G:BX the following mapping:

G(x)=Γ(x)F(x)12Γ(x)F′′(x)[Γ(x)F(x)]2, (4)

where Γ(x)=F(x)1.

It can be easily seen that for all xB the following identity holds

F(x)+F(x)G(x)+12F′′(x)G2(x)=
=12F′′(x)[F(x)1F(x),F(x)1F′′(x)[F(x)1F(x)]2]+
+18F′′(x)[F(x)1F′′(x)[F(x)1F(x)]2]2

whence we obtain

F(x)+F(x)G(x)+12F′′(x)G2(x)12K2β4(1+14m0Kβ2)F(x)3, (5)

or

F(x)+F(x)G(x)+12F′′(x)G2(x)μF(x)3, for all xB. (6)

Similarly, using (4) and taking into account the notations we made, we get

G(x)νF(x), for all xB. (7)

From the hypotheses of the theorem, the inequality (6) and the fact that F′′′(x)=θ3, we obtain the following inequality:

F(x1) F(x1)F(x0)F(x0)G(x0)12F′′(x0)G2(x0)+
+F(x0)+F(x0)G(x0)+12F′′(x0)G2(x0)
μF(x0)3.

Since x1x0=G(x0), by (6) we have

x1x0νF(x0)=νμF(x0)μ<νρ0μ(1ρ0)δ,

whence it follows that x1B.

Suppose now that the following properties hold:

  • a)

    xiB, i=0,,k;

  • b)

    F(xi)μF(xi1)3,i=1,,k.

By the fact that xkB, using (6) it follows

F(xk+1)μF(xk)3, (8)

and from relation xk+1xk=G(xk)

xk+1xk<νF(xk). (9)

The inequalities b) and (8) lead us to

F(xi)1μ(μF(x0))3i,i=1,,k+1. (10)

We have that xk+1B:

xk+1x0i=1k+1xixi1i=1k+1νF(xi1)νμi=1k+1ρ03i1νρ0(1ρ0)μ.

Now we shall prove that the sequence (xk)k0 is Cauchy. Indeed, for all m,k we have

xk+mxk i=0m1xk+i+1xk+iνi=0m1F(xk+i) (11)
νμi=0m1ρ03k+i=νμρ03ki=0m1ρ03k+i3kνρ03kμ(1ρ03k),

whence, taking into account that ρ0<1, it follows that (xk)k0 converges. Let x=limkxk. Then, for m in (11) it follows jv. The consequence jjj follows from (9) and (10).

3 Application and numerical examples

We shall study this method when applied to approximate the eigenpairs of matrices.

Denote V=𝕂n and let A 𝕂n×n where 𝕂= or . For computing the eigenpairs of A one may consider a norming function G:V𝕂 with G(0)1. The eigenvalues λ 𝕂 and eigenvectors vV of A are the solutions of the nonlinear system

F(x)=(AvλvG(v)1)=0,

where x=(vλ)V×𝕂=𝕂n+1, (x(1),x(2),,x(n))=v and x(n+1)=λ. The first n components of F, Fi, i=1,,n, are given by

Fi(x)= ai1x(1)++ai,i1x(i1)+(aiix(n+1))x(i)
+ai,i+1x(i+1)++ainx(n).

The standard choice for G is

G(v)=αv2,

with α=12. We have proposed in [4] (see also [7]), the choice α=12n, which has shown a better behavior for the iterates than the standard choice.

In both cases we can write

Fn+1(x)=α((x(1))2++(x(n))2)1.

The first and the second order derivatives of F are given by

F(x)h=(a11x(n+1)a12a1nx(1)a21a22x(n+1)a2nx(2)an1an2annx(n+1)x(n)2αx(1)2αx(2)2αx(n)0)(h(1)h(2)h(n)h(n+1)),

and

F′′(x)hk=(k(n+1)00k(1)0k(n+1)0k(2)00k(n+1)k(n)2αk(1)2αk(2)2αk(n)0)(h(1)h(2)h(n)h(n+1)),

where x=(x(i))i=1,n+1,h=(h(i))i=1,n+1,k=(k(i))i=1,n+1𝕂n+1.

We shall consider two test matrices from the Harwell Boeing collection111These matrices are available from MatrixMarket at the following address: http://math.nist.gov/MatrixMarket/. in order to study the behavior of the Chebyshev method for approximating the eigenpairs. The programs were written in Matlab. As in [20], we used the Matlab operator ’\’ for solving the linear systems.

Fidap002 matrix. This real symmetric matrix of dimension n=441 arises from finite element modelling. Its eigenvalues (contained on the diagonal of D, after using the Matlab command [V,D]=eig(A)) are all simple and range from 7108 to 3106. As in [20], we have chosen to study the smallest eigenvalue, λ=D(1,1), which is well separated. Its corresponding eigenvector V(:,1) has the Euclidean norm equal to 1, and therefore we have v=sqrt(2) * V(:,1) for the first choice, respectively v=sqrt(2*n) * V(:,1) for the second choice.

It is interesting to note that F(x)2=3.7e7 in the first case, and F(x)2=9.1e6 in the second case.

The initial approximations were taken λ0=λ+102=6.999 6108+100, and for the initial vector v0 we perturbed the solution v with random vectors having the components uniformly distributed on (ε,ε), ε=0.3. This lead in a relative error x0xx=7.0101 in the first case, and x0xx=3.3100 in the second one.

The following results are typical for the runs made (we have considered a common perturbation vector); Table 1 contains the norms of the vectors F(xk).

Table 1: The Fidap002 matrix.
Choice α=12 Choice α=12n
k F(xk) F(xk)
0 2.4810+9 2.4810+9
1 5.1010+4 2.4110+1
2 6.8110+3 4.7010-6
3 9.3410+2
4 7.0610+1
5 4.8610-2
6 2.8110-7

The values of ε must be decreased to 0.03 for the iterates with first choice to attain the solution at step k=2 (as it does with choice two), while the same ε may be increased to 7 for the iterates with the second choice to attain the solution at step k=6.

Because of the scalings, the components of the eigenvector when taken with the second choice may be affected by larger errors than with the first choice.

Sherman1 matrix. This matrix arises from oil reservoir simulation. It is real, unsymmetric, of dimension 1000 and all its eigenvalues are real. We have chosen to study the smallest eigenvalue λ=5.0449, which is not well separated (the closest eigenvalue is 4.9376). The initial approximation was taken λ0=λ+0.05 and for the initial vector v0 we considered ε=0.01. The following results are typical for the runs made (we have considered again a same random perturbation vector for the initial approximations). The relative errors x0xx for the two choices were 2.65101 resp. 8.38103.

Table 2: Sherman1 matrix.
Choice α=12 Choice α=12n
k F(xk) F(xk)
0 1.5710+00 2.7310+00
1 1.1810-02 6.3910-03
2 2.6910-03 1.7210-09
3 4.0210-09 2.5810-14
4 8.0810-16

For this particular matrix and eigenvalue, the Chebyshev method has shown a strong sensitivity to the size of the perturbations: increasing ε leads to the loss of the convergence of the Chebyshev iterates.

As it can be seen from both examples, the second choice presents a better behavior than the first one.

References

  • [1] Argyros, I.K., Quadratic equations and applications to Chandrasekhar’s and related equations, Bull. Austral. Math. Soc., 38, pp. 275–292, 1988.
  • [2] Cătinaş, E., The inexact, inexact perturbed and quasi-Newton methods are equivalent models, Math. Comp., to appear. 74 (2005) no. 249, 291–301.
  • [3] Cătinaş, E. and I. Păvăloiu, On the Chebyshev method for approximating the eigenvalues of linear operators, Rev. Anal. Numér. Théor. Approx. 25 nos. 1–2, pp. 43–56, 1996.
  • [4] Cătinaş, E. and I. Păvăloiu, On the Chebyshev method for approximating the eigenvalues of linear operators, Proceedings of International Conference on Approximation and Optimization, Cluj-Napoca, July 29 – August 1, vol. 1, pp. 219–226, 1996.
  • [5] Cătinaş, E. and I. Păvăloiu, On approximating the eigenvalues and eigenvectors of linear continuous operators, Rev. Anal. Numér. Théor. Approx., 26, nos. 1–2, pp. 19–27, 1997.
  • [6] Cătinaş, E. and I. Păvăloiu, On some interpolatory iterative methods for the second degree polynomial operators (I), Rev. Anal. Numér. Théor. Approx., 27, pp. 33–45, 1998.
  • [7] Cătinaş, E. and I. Păvăloiu, On some interpolatory iterative methods for the second degree polynomial operators (II), Rev. Anal. Numér. Théor. Approx., 28, no. 2, pp. 133–143, 1999.
  • [8] Ciarlet, P.G., Introduction à l’Analyse Numérique Matricielle et à l’Optimisation, Masson, Paris, 1990.
  • [9] Diaconu, A., On the convergence of an iterative method of Chebyshev type, Rev. Anal. Numér. Théor. Approx., 24, nos. 1–2, pp. 91–102, 1995.
  • [10] Dongarra, J.J., C.B. Moler and J.H. Wilkinson, Improving the accuracy of the computed eigenvalues and eigenvectors, SIAM J. Numer. Anal., 20, pp. 23–45, 1983.
  • [11] Grzegórski, S.M., On the scaled Newton method for the symmetric eigenvalue problem, Computing, 45, pp. 277–282, 1990.
  • [12] Ortega, J.M. and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, New York, 1970.
  • [13] Păvăloiu, I., Sur les procédés itératifs à un ordre élevé de convergence, Mathematica (Cluj), 12 (35), no. 2, pp. 309–324, 1970.
  • [14] Păvăloiu, I., Introduction to the Theory of Approximating the Solutions of Equations, Ed. Dacia, Cluj-Napoca, Romania, 1986 (in Romanian).
  • [15] Păvăloiu, I. and E. Cătinaş, Remarks on some Newton and Chebyshev-type methods for approximating the eigenvalues and eigenvectors of matrices, Computer Science Journal of Moldova, 7, no. 1, pp. 3–17, 1999.
  • [16] Peters, G. and J.H. Wilkinson, Inverse iteration, ill-conditioned equations and Newton’s method, SIAM Review, 21, no. 3, pp. 339–360, 1979.
  • [17] Santos, M.C., A note on the Newton iteration for the algebraic eigenvalue problem, SIAM J. Matrix Anal. Appl., 9, no. 4, pp. 561–569, 1988.
  • [18] Tapia, R.A. and L.D. Whitley, The projected Newton method has order 1+2 for the symmetric eigenvalue problem, SIAM J. Numer. Anal., 25, no. 6, pp. 1376–1382, 1988.
  • [19] Tisseur, F., Newton’s method in floating point arithmetic and iterative refinement of generalized eigenvalue problems, SIAM J. Matrix Anal. Appl., 22, no. 4, pp. 1038–1057, 2001.
  • [20] Wu K., Y. Saad and A. Stathopoulos, Inexact Newton preconditioning techniques for large symmetric eigenvalue problems, Electronic Transactions on Numerical Analysis, 7, pp. 202–214, 1998.
  • [21] Yamamoto, T., Error bounds for computed eigenvalues and eigenvectors, Numer. Math., 34, pp. 189–199, 1980.
2004

Related Posts