Abstract
Authors
I. Păvăloiu (Tiberiu Popoviciu Institute of Numerical Analysis)
Emil Cătinaş (Tiberiu Popoviciu Institute of Numerical Analysis)
Keywords
?
Paper coordinates
I. Păvăloiu, E. Cătinaş, On the Chebyshev method with numerical applications to the eigenpair problem, Symbolic and Numeric Algorithms for Scientific Computations (SYNASC03), Proceedings of the 5th International Workshop, Timisoara, Romania, October 1-4, D. Petcu, V. Negru, D. Zaharie and T. Jebelean (eds.), pp. 204-210, 2003, ISBN 973-585-785-5.
About this paper
Journal
Publisher Name
DOI
Print ISSN
Online ISSN
google scholar link
[1] Argyros, I.K., Quadratic equations and applications to Chandrasekhar’s and related equations, Bull. Austral. Math. Soc., 38, pp. 275–292, 1988.
[2] Cătinaş, E., The inexact, inexact perturbed and quasi-Newton methods are equivalent models, Math. Comp., to appear. 74 (2005) no. 249, 291–301.
[3] Cătinaş, E. and I. Păvăloiu, On the Chebyshev method for approximating the eigenvalues of linear operators, Rev. Anal. Numér. Théor. Approx. 25 nos. 1–2, pp. 43–56, 1996.
[4] Cătinaş, E. and I. Păvăloiu, On the Chebyshev method for approximating the eigenvalues of linear operators, Proceedings of International Conference on Approximation and Optimization, Cluj-Napoca, July 29 – August 1, vol. 1, pp. 219–226, 1996.
[5] Cătinaş, E. and I. Păvăloiu, On approximating the eigenvalues and eigenvectors of linear continuous operators, Rev. Anal. Numér. Théor. Approx., 26, nos. 1–2, pp. 19–27, 1997.
[6] Cătinaş, E. and I. Păvăloiu, On some interpolatory iterative methods for the second degree polynomial operators (I), Rev. Anal. Numér. Théor. Approx., 27, pp. 33–45, 1998.
[7] Cătinaş, E. and I. Păvăloiu, On some interpolatory iterative methods for the second degree polynomial operators (II), Rev. Anal. Numér. Théor. Approx., 28, no. 2, pp. 133–143, 1999.
[8] Ciarlet, P.G., Introduction à l’Analyse Numérique Matricielle et à l’Optimisation, Masson, Paris, 1990.
[9] Diaconu, A., On the convergence of an iterative method of Chebyshev type, Rev. Anal. Numér. Théor. Approx., 24, nos. 1–2, pp. 91–102, 1995.
[10] Dongarra, J.J., C.B. Moler and J.H. Wilkinson, Improving the accuracy of the computed eigenvalues and eigenvectors, SIAM J. Numer. Anal., 20, pp. 23–45, 1983.
[11] Grzegórski, S.M., On the scaled Newton method for the symmetric eigenvalue problem, Computing, 45, pp. 277–282, 1990.
[12] Ortega, J.M. and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, New York, 1970.
[13] Păvăloiu, I., Sur les procédés itératifs à un ordre élevé de convergence, Mathematica (Cluj), 12 (35), no. 2, pp. 309–324, 1970.
[14] Păvăloiu, I., Introduction to the Theory of Approximating the Solutions of Equations, Ed. Dacia, Cluj-Napoca, Romania, 1986 (in Romanian).
[15] Păvăloiu, I. and E. Cătinaş, Remarks on some Newton and Chebyshev-type methods for approximating the eigenvalues and eigenvectors of matrices, Computer Science Journal of Moldova, 7, no. 1, pp. 3–17, 1999.
[16] Peters, G. and J.H. Wilkinson, Inverse iteration, ill-conditioned equations and Newton’s method, SIAM Review, 21, no. 3, pp. 339–360, 1979.
[17] Santos, M.C., A note on the Newton iteration for the algebraic eigenvalue problem, SIAM J. Matrix Anal. Appl., 9, no. 4, pp. 561–569, 1988.
[18] Tapia, R.A. and L.D. Whitley, The projected Newton method has order
for the symmetric eigenvalue problem, SIAM J. Numer. Anal., 25, no. 6, pp. 1376–1382, 1988.
[19] Tisseur, F., Newton’s method in floating point arithmetic and iterative refinement of generalized eigenvalue problems, SIAM J. Matrix Anal. Appl., 22, no. 4, pp. 1038–1057, 2001.
[20] Wu K., Y. Saad and A. Stathopoulos, Inexact Newton preconditioning techniques for large symmetric eigenvalue problems, Electronic Transactions on Numerical Analysis, 7, pp. 202–214, 1998.
[21] Yamamoto, T., Error bounds for computed eigenvalues and eigenvectors, Numer. Math., 34, pp. 189–199, 1980.
Paper (preprint) in HTML form
On the Chebyshev method, with numerical applications to the eigenpair problem
Abstract
We present a semilocal convergence result for the Chebyshev method applied to a polynomial system of equations of degree .
We apply the method in order to approximate the eigenpairs of matrices. The norming function we have proposed in a previous paper of us shows on test matrices better convergence properties of the iterates than the classical norming function.
keywords:
systems of polynomial equations of degree , Chebyshev method, eigenvalue/eigenvector problem.65H10.
1 INTRODUCTION
Let be a nonlinear mapping, where is a Banach space, and consider the equation
| (1) |
We shall assume that is a polynomial of degree , i.e., it is indefinitely differentiable on , with , for all and , where is the -linear null operator.
In the present paper we shall study the convergence of the Chebyshev method
We shall apply this study to the approximation of the eigenpairs of the linear operators in Banach spaces, and we shall consider some numerical examples for some test matrices.
2 A semilocal convergence result
The iterative Chebyshev method for solving equation (1) consists in the successive construction of the elements of the sequence given by
| (2) |
where
Let and be two real numbers. Denote If , then and
Consider the numbers
| (3) |
With the above notations, the following theorem holds:
Theorem 1
If the operator is three times differentiable with for all and if, moreover, there exist , such that the following relations hold
-
i.
the operator has a bounded inverse for all , and
- ii.
then the following properties hold:
-
j.
the sequence given by (2) is convergent;
-
jj.
denoting then and
-
jjj.
-
jv.
.
Denote by the following mapping:
| (4) |
where
It can be easily seen that for all the following identity holds
whence we obtain
| (5) |
or
| (6) |
Similarly, using (4) and taking into account the notations we made, we get
| (7) |
From the hypotheses of the theorem, the inequality (6) and the fact that , we obtain the following inequality:
Suppose now that the following properties hold:
-
a)
,
-
b)
The inequalities b) and (8) lead us to
| (10) |
We have that :
3 Application and numerical examples
We shall study this method when applied to approximate the eigenpairs of matrices.
Denote and let where or For computing the eigenpairs of one may consider a norming function with The eigenvalues and eigenvectors of are the solutions of the nonlinear system
where and . The first components of , , , are given by
The standard choice for is
with . We have proposed in [4] (see also [7]), the choice , which has shown a better behavior for the iterates than the standard choice.
In both cases we can write
The first and the second order derivatives of are given by
and
where
We shall consider two test matrices from the Harwell Boeing collection111These matrices are available from MatrixMarket at the following address: http://math.nist.gov/MatrixMarket/. in order to study the behavior of the Chebyshev method for approximating the eigenpairs. The programs were written in Matlab. As in [20], we used the Matlab operator ’’ for solving the linear systems.
Fidap002 matrix. This real symmetric matrix of dimension arises from finite element modelling. Its eigenvalues (contained on the diagonal of D, after using the Matlab command [V,D]=eig(A)) are all simple and range from to . As in [20], we have chosen to study the smallest eigenvalue, D(1,1), which is well separated. Its corresponding eigenvector V(:,1) has the Euclidean norm equal to , and therefore we have sqrt(2) * V(:,1) for the first choice, respectively sqrt(2*n) * V(:,1) for the second choice.
It is interesting to note that in the first case, and in the second case.
The initial approximations were taken , and for the initial vector we perturbed the solution with random vectors having the components uniformly distributed on (,), . This lead in a relative error in the first case, and in the second one.
The following results are typical for the runs made (we have considered a common perturbation vector); Table 1 contains the norms of the vectors .
| Choice | Choice | ||
|---|---|---|---|
| 0 | 2.4810+9 | 2.4810+9 | |
| 1 | 5.1010+4 | 2.4110+1 | |
| 2 | 6.8110+3 | 4.7010-6 | |
| 3 | 9.3410+2 | ||
| 4 | 7.0610+1 | ||
| 5 | 4.8610-2 | ||
| 6 | 2.8110-7 | ||
The values of must be decreased to for the iterates with first choice to attain the solution at step (as it does with choice two), while the same may be increased to for the iterates with the second choice to attain the solution at step .
Because of the scalings, the components of the eigenvector when taken with the second choice may be affected by larger errors than with the first choice.
Sherman1 matrix. This matrix arises from oil reservoir simulation. It is real, unsymmetric, of dimension 1000 and all its eigenvalues are real. We have chosen to study the smallest eigenvalue , which is not well separated (the closest eigenvalue is ). The initial approximation was taken and for the initial vector we considered . The following results are typical for the runs made (we have considered again a same random perturbation vector for the initial approximations). The relative errors for the two choices were resp. .
| Choice | Choice | |||
|---|---|---|---|---|
| 0 | 1.5710+00 | 2.7310+00 | ||
| 1 | 1.1810-02 | 6.3910-03 | ||
| 2 | 2.6910-03 | 1.7210-09 | ||
| 3 | 4.0210-09 | 2.5810-14 | ||
| 4 | 8.0810-16 | |||
For this particular matrix and eigenvalue, the Chebyshev method has shown a strong sensitivity to the size of the perturbations: increasing leads to the loss of the convergence of the Chebyshev iterates.
As it can be seen from both examples, the second choice presents a better behavior than the first one.
References
- [1] Argyros, I.K., Quadratic equations and applications to Chandrasekhar’s and related equations, Bull. Austral. Math. Soc., 38, pp. 275–292, 1988.
- [2] Cătinaş, E., The inexact, inexact perturbed and quasi-Newton methods are equivalent models, Math. Comp., to appear. 74 (2005) no. 249, 291–301.
- [3] Cătinaş, E. and I. Păvăloiu, On the Chebyshev method for approximating the eigenvalues of linear operators, Rev. Anal. Numér. Théor. Approx. 25 nos. 1–2, pp. 43–56, 1996.
- [4] Cătinaş, E. and I. Păvăloiu, On the Chebyshev method for approximating the eigenvalues of linear operators, Proceedings of International Conference on Approximation and Optimization, Cluj-Napoca, July 29 – August 1, vol. 1, pp. 219–226, 1996.
- [5] Cătinaş, E. and I. Păvăloiu, On approximating the eigenvalues and eigenvectors of linear continuous operators, Rev. Anal. Numér. Théor. Approx., 26, nos. 1–2, pp. 19–27, 1997.
- [6] Cătinaş, E. and I. Păvăloiu, On some interpolatory iterative methods for the second degree polynomial operators (I), Rev. Anal. Numér. Théor. Approx., 27, pp. 33–45, 1998.
- [7] Cătinaş, E. and I. Păvăloiu, On some interpolatory iterative methods for the second degree polynomial operators (II), Rev. Anal. Numér. Théor. Approx., 28, no. 2, pp. 133–143, 1999.
- [8] Ciarlet, P.G., Introduction à l’Analyse Numérique Matricielle et à l’Optimisation, Masson, Paris, 1990.
- [9] Diaconu, A., On the convergence of an iterative method of Chebyshev type, Rev. Anal. Numér. Théor. Approx., 24, nos. 1–2, pp. 91–102, 1995.
- [10] Dongarra, J.J., C.B. Moler and J.H. Wilkinson, Improving the accuracy of the computed eigenvalues and eigenvectors, SIAM J. Numer. Anal., 20, pp. 23–45, 1983.
- [11] Grzegórski, S.M., On the scaled Newton method for the symmetric eigenvalue problem, Computing, 45, pp. 277–282, 1990.
- [12] Ortega, J.M. and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, New York, 1970.
- [13] Păvăloiu, I., Sur les procédés itératifs à un ordre élevé de convergence, Mathematica (Cluj), 12 (35), no. 2, pp. 309–324, 1970.
- [14] Păvăloiu, I., Introduction to the Theory of Approximating the Solutions of Equations, Ed. Dacia, Cluj-Napoca, Romania, 1986 (in Romanian).
- [15] Păvăloiu, I. and E. Cătinaş, Remarks on some Newton and Chebyshev-type methods for approximating the eigenvalues and eigenvectors of matrices, Computer Science Journal of Moldova, 7, no. 1, pp. 3–17, 1999.
- [16] Peters, G. and J.H. Wilkinson, Inverse iteration, ill-conditioned equations and Newton’s method, SIAM Review, 21, no. 3, pp. 339–360, 1979.
- [17] Santos, M.C., A note on the Newton iteration for the algebraic eigenvalue problem, SIAM J. Matrix Anal. Appl., 9, no. 4, pp. 561–569, 1988.
- [18] Tapia, R.A. and L.D. Whitley, The projected Newton method has order for the symmetric eigenvalue problem, SIAM J. Numer. Anal., 25, no. 6, pp. 1376–1382, 1988.
- [19] Tisseur, F., Newton’s method in floating point arithmetic and iterative refinement of generalized eigenvalue problems, SIAM J. Matrix Anal. Appl., 22, no. 4, pp. 1038–1057, 2001.
- [20] Wu K., Y. Saad and A. Stathopoulos, Inexact Newton preconditioning techniques for large symmetric eigenvalue problems, Electronic Transactions on Numerical Analysis, 7, pp. 202–214, 1998.
- [21] Yamamoto, T., Error bounds for computed eigenvalues and eigenvectors, Numer. Math., 34, pp. 189–199, 1980.
