Abstract
We present a semilocal convergence result for a Newton-type method applied to a polynomial operator equation of degree (2).
The method consists in fact in evaluating the Jacobian at every two steps, and it has the r-convergence order at least (3). We apply the method in order to approximate the eigenpairs of matrices.
We perform some numerical examples on some test matrices and compare the method with the Chebyshev method. The norming function we have proposed in a previous paper shows a better convergence of the iterates than the classical norming function for both the methods.
Authors
Emil Cătinaş
(Tiberiu Popoviciu Institute of Numerical Analysis)
Ion Păvăloiu
(Tiberiu Popoviciu Institute of Numerical Analysis)
Keywords
nonlinear equations; abstract polynomial equations of degree 2; r-convergence order.
Cite this paper as:
E. Cătinaş, I. Păvăloiu, On a third order iterative method for solving polynomial operator equations, Rev. Anal. Numér. Théor. Approx., 31 (2002) no. 1, pp. 21-28. https://doi.org/10.33993/jnaat311-705
PDF-LaTeX file (on the journal website).
About this paper
Publisher Name
Print ISSN
1222-9024
Online ISSN
2457-8126
MR
1222-9024
Online ISSN
2457-8126
Google Scholar citations
[2] I.K. Argyros, Quadratic equations and applications to Chandrasekhar’s and related equations , Bull. Austral. Math. Soc., 38 (1988), pp. 275–292.
[3] E. Catinas and I. Pavaloiu, On the Chebyshev method for approximating the eigenvalues of linear operators, Rev. Anal. Numer. Theor. Approx., 25 (1996) nos. 1–2, pp. 43-56.
[4] E. Catinas and I. Pavaloiu, On a Chebyshev-type method for approximating the solutions of polynomial operator equations of degree 2, Proceedings of International Conference on Approximation and Optimization, Cluj-Napoca, July 29 – august 1, 1996, vol. 1, pp. 219-226.
[5] E. Catinas and I. Pavaloiu, On approximating the eigenvalues and eigenvectors of linear continuous operators, Rev. Anal. Numer. Theor. Approx., 26 (1997) nos. 1–2, pp. 19–27.
[6] E. Catinas and I. Pavaloiu, On some interpolatory iterative methods for the second degree polynomial operators (I), Rev. Anal. Numer. Theor. Approx., 27(1998) no. 1, pp. 33-45.
[7] E. Catinas and I. Pavaloiu, On some interpolatory iterative methods for the second degree polynomial operators (II) , Rev. Anal. Numer. Theor. Approx., 28 (1999) no. 2, pp. 133-143.
[8] L. Collatz, Functionalanalysis und Numerische Mathematik, Springer-Verlag, Berlin,1964.
[9] A. Diaconu, On the convergence of an iterative method of Chebyshev type, Rev. Anal. Numer. Theor. Approx. 24 (1995) nos. 1–2, pp. 91–102.
[10] J.J. Dongarra, C.B. Moler and J.H. Wilkinson, Improving the accuracy of the computed eigenvalues and eigenvectors , SIAM J. Numer. Anal., 20 (1983) no. 1, pp. 23–45.
[11] S.M. Grzegorski, On the scaled Newton method for the symmetric eigenvalue problem, Computing, 45 (1990), pp. 277–282.
[12] V.S. Kartisov and F.L. Iuhno, O nekotorih Modifikat ̧ah Metoda Niutona dlea Resenia Nelineinoi Spektralnoi Zadaci, J. Vicisl. matem. i matem. fiz., 33 (1973) no. 9, pp. 1403–1409 (in Russian).
[13] J.M. Ortega and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables , Academic Press, New York, 1970.
[14] I. Pavaloiu, Sur les procedes iteratifs a un order eleve de convergence, Mathematica (Cluj), 12 (35) (1970) no. 2, pp. 309–324.
[15] Pavaloiu, I., Introduction to the Theory of Approximating the Solutions of Equations, Ed. Dacia, Cluj-Napoca, Romania, 1986 (in Romanian).
[16] I. Pavaloiu and E. Catinas, Remarks on some Newton and Chebyshev-type methods for approximating the eigenvalues and eigenvectors of matrices, Computer Science Journal of Moldova, 7(1999) no. 1, pp. 3–17.
[17] G. Peters and J.H. Wilkinson, Inverse iteration, ill-conditioned equations and Newton’s method, SIAM Review, 21(1979) no. 3, pp. 339–360.
[18] M.C. Santos, A note on the Newton iteration for the algebraic eigenvalue problem, SIAM J. Matrix Anal. Appl., 9 (1988) no. 4, pp. 561–569.
[19] R.A. Tapia and L.D. Whitley, The projected Newton method has order 1+√2 for the symmetric eigenvalue problem, SIAM J. Numer. Anal., 25 (1988) no. 6, pp. 1376–1382.
[20] F. Tisseur, Newton’s method in floating point arithmetic and iterative refinement of generalized eigenvalue problems, SIAM J. Matrix Anal. Appl., 22 (2001) no. 4, pp. 1038–1057.
[21] K. Wu, Y. Saad and A. Stathopoulos, Inexact Newton preconditioning techniques for large symmetric eigenvalue problems, Electronic Transactions on Numerical Analysis, 7 (1998) pp. 202–214.
[22] T. Yamamoto, Error bounds for computed eigenvalues and eigenvectors, Numer. Math., 34 (1980), pp. 189–199.
Paper (preprint) in HTML form
ON A THIRD ORDER ITERATIVE METHOD
FOR SOLVING POLYNOMIAL OPERATOR EQUATIONS∗
Abstract.
We present a semilocal convergence result for a Newton-type method applied to a polynomial operator equation of degree . The method consists in fact in evaluating the Jacobian at every two steps, and it has the -convergence order at least .
We apply the method in order to approximate the eigenpairs of matrices. We perform some numerical examples on some test matrices and compare the method to the Chebyshev method. The norming function we have proposed in a previous paper shows a better convergence of the iterates than the classical norming function for both the methods.
65H10.
two-step Newton method, Chebyshev method, eigenpair problems.
1. Introduction
Let be a nonlinear mapping, where is a Banach space, and consider the equation
(1) |
We shall assume that is a polynomial operator of degree , i.e., it is indefinitely differentiable on , with , for all and , where is the -linear null operator.
Besides (1) we shall also consider another equation, equivalent with it
(2) |
where . More exactly, we shall assume that the solutions of (1) coincide with the solutions of (2) and viceversa.
In [15] it was shown that the following iterations
(3) |
have the convergence order with one order higher than the convergence order of the iterates
Obviously, if we take as the Newton operator, i.e.,
(4) |
then we obtain a method with the convergence order at least .
In the present paper we shall study the convergence of the iterations (3), with given by (4), i.e.,
(5) |
in order to solve the polynomial equation (1).
By (5), for some known approximation , the next approximation may be determined as
We notice that at each iteration step we need to solve two linear equations, but for the same linear operator, . The iterations may be viewed as being given by the Newton method in which the Jacobian is evaluated at every two steps.
A possible advantage of the above method over the Chebyshev method
which has the same convergence order, is that it does not require the second derivative of , which may have a complicate form.
The study of such methods for second degree polynomial equations is important, since such equations often arise in practice. We mention the eigenvalue problem (see, e.g., [21], [20]), some integral equations (see, e.g., [2], [8]), etc.
We shall apply this study to the approximation of the eigenpairs of the matrices, and we shall consider some numerical examples for some test matrices. We shall also compare the method (5) to the Chebyshev method.
2. A semilocal convergence result
Since is a second degree polynomial, one can easily show that
(6) |
Assuming that exists, denote by the following expression:
(7) |
Taking into account (6), we get
(8) |
Since the bilinear operator does not depend on , denote .
Let , denote , and assume that . Using the Banach lemma, it easily follows that for all , there exists , and
(11) |
Now take
(14) | ||||
We obtain the following result regarding the convergence of (5).
Theorem 1.
If the mapping , the initial approximation , and the real numbers , , satisfy:
-
i.
is a second degree polynomial;
-
ii.
, assuming that exists and
-
iii.
-
iv.
,
then the following statements are true:
Proof.
Assumptions iii. and (6) imply that .
Assume now the following relations:
-
a)
-
b)
-
c)
and
We shall prove that
(20) |
where
But and hence
This implies
i.e.,
Hence
Now we show that the sequence is fundamental. From the above relations we have
(21) |
for all Since , we get that the sequence is Cauchy. Denote .
By (21), for we get
The continuity of implies that Obviously, . ∎
3. Application and numerical examples
We shall study this method when applied to approximate the eigenpairs of matrices.
Denote and let , where or For computing the eigenpairs of one may consider a norming function with The eigenvalues and eigenvectors of are the solutions of the nonlinear system
where and . The first components of , , , are given by
The standard choice for is
with . We have proposed in [4] (see also [7]), the choice , which has shown a better behavior for the iterates than the standard choice.
In both cases we can write
The first and the second order derivatives of are given by
and
where
We shall consider two test matrices from the Harwell Boeing collection111These matrices are available from MatrixMarket at the following address: http://math.nist.gov/MatrixMarket/. in order to study the behavior of the method (5) and of the Chebyshev method for approximating the eigenpairs. The programs were written in Matlab. As in [21], we used the Matlab operator ’’ for solving the linear systems.
Fidap002 matrix. This real symmetric matrix of dimension arises from finite element modeling. Its eigenvalues are all simple and range from to . As in [21], we have chosen to study the smallest eigenvalue, which is well separated. The initial approximations were taken , and for the initial vector we perturbed the solution (computed by Matlab and then properly scaled to fulfill the norming equation) with random vectors having the components uniformly distributed on (-,), . The following results are typical for the runs made (we have considered a common perturbation vector); Table 1 contains the norms of the vectors . For the choice I, we took in , while for the choice II, .
It is interesting to note that the norm of (even at the computed solution) does not decrease below .
Choice I | Choice II | |||
---|---|---|---|---|
Method (5) | Chebyshev method | Method (5) | Chebyshev method | |
0 | 1.000 310+2 | 1.746 710+9 | 2.510 710+0 | 1.746 710+9 |
1 | 1.007 810+1 | 8.733 510+8 | 1.255 310+0 | 8.733 510+8 |
2 | 3.485 310+1 | 1.646 210+2 | 5.287 710-2 | 3.564 110-3 |
3 | 2.136 810+0 | 2.337 310+1 | 6.180 410-5 | 4.904 810-6 |
4 | 4.476 110-1 | 6.352 110-1 | 5.985 810-7 | 4.430 910-6 |
5 | 6.521 410-3 | 9.223 810-3 | ||
6 | 1.561 710-5 | 2.296 110-5 | ||
7 | 5.960 510-7 | 8.564 710-8 |
Sherman1 matrix. This matrix arises from oil reservoir simulation. It is real, unsymmetric, of dimension 1000 and all its eigenvalues are real. We have chosen to study the smallest eigenvalue , which is not well separated (the closest eigenvalue is ). The initial approximation was taken and for the initial vector we considered .
The following results are typical for the runs made (we have considered again a same random perturbation vector for the four initial approximations).
Choice I | Choice II | |||
---|---|---|---|---|
Method (5) | Chebyshev method | Method (5) | Chebyshev method | |
0 | 7.717 710-01 | 7.717 710-01 | 7.763 810-01 | 7.763 810-01 |
1 | 6.924 210-05 | 3.223 710-02 | 1.218 810-06 | 3.224 810-05 |
2 | 2.359 310-13 | 4.994 810-04 | 2.754 110-14 | 5.197 310-10 |
3 | 7.117 110-16 | 1.246 610-07 | 4.020 710-14 | |
4 | 7.814 310-15 | |||
5 | 9.165 510-16 |
For this particular matrix and eigenvalue, the Chebyshev method has shown a greater sensitivity to the size of the perturbations than method (5). Increasing leads to the loss of the convergence of the Chebyshev iterates, while method (5) still converge.
Though for the Sherman1 matrix method (5) displayed a better behavior than the Chebyshev method, some extensive tests must be performed before affirming that the first method is superior. In any case, the choice II has shown again that is more advantageous to use.
References
- [1] M.P. Anselone and L.B. Rall, The solution of characteristic value-vector problems by Newton method, Numer. Math., 11 (1968), pp. 38–45.
- [2] I.K. Argyros, Quadratic equations and applications to Chandrasekhar’s and related equations, Bull. Austral. Math. Soc., 38 (1988), pp. 275–292.
- [3] E. Cătinaş and I. Păvăloiu, On the Chebyshev method for approximating the eigenvalues of linear operators, Rev. Anal. Numér. Théor. Approx., 25 (1996) nos. 1–2, pp. 43–56.
- [4] E. Cătinaş and I. Păvăloiu, On a Chebyshev-type method for approximating the solutions of polynomial operator equations of degree 2, Proceedings of International Conference on Approximation and Optimization, Cluj-Napoca, July 29 - august 1, 1996, vol. 1, pp. 219-226.
- [5] E. Cătinaş and I. Păvăloiu, On approximating the eigenvalues and eigenvectors of linear continuous operators, Rev. Anal. Numér. Théor. Approx., 26 (1997) nos. 1–2, pp. 19–27.
- [6] E. Cătinaş and I. Păvăloiu, On some interpolatory iterative methods for the second degree polynomial operators (I), Rev. Anal. Numér. Théor. Approx., 27 (1998) no. 1, pp. 33-45.
- [7] E. Cătinaş and I. Păvăloiu, On some interpolatory iterative methods for the second degree polynomial operators (II), Rev. Anal. Numér. Théor. Approx., 28 (1999) no. 2, pp. 133-143.
- [8] L. Collatz, Functionalanalysis und Numerische Mathematik, Springer-Verlag, Berlin, 1964.
- [9] A. Diaconu, On the convergence of an iterative method of Chebyshev type, Rev. Anal. Numér. Théor. Approx. 24 (1995) nos. 1–2, pp. 91–102.
- [10] J.J. Dongarra, C.B. Moler and J.H. Wilkinson, Improving the accuracy of the computed eigenvalues and eigenvectors, SIAM J. Numer. Anal., 20 (1983) no. 1, pp. 23–45.
- [11] S.M. Grzegórski, On the scaled Newton method for the symmetric eigenvalue problem, Computing, 45 (1990), pp. 277–282.
- [12] V.S. Kartîşov, and F.L. Iuhno, O nekotorîh Modifikaţiah Metoda Niutona dlea Resenia Nelineinoi Spektralnoi Zadaci, J. Vîcisl. matem. i matem. fiz., 33 (1973) no. 9, pp. 1403–1409 (in Russian).
- [13] J.M. Ortega, and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, New York, 1970.
- [14] I. Păvăloiu, Sur les procédés itératifs à un order élevé de convergence, Mathematica (Cluj), 12(35) (1970) no. 2, pp. 309–324.
- [15] Pǎvǎloiu, I., Introduction to the Theory of Approximating the Solutions of Equations, Ed. Dacia, Cluj-Napoca, Romania, 1986 (in Romanian).
- [16] I. Păvăloiu and E. Cătinaş, Remarks on some Newton and Chebyshev-type methods for approximating the eigenvalues and eigenvectors of matrices, Computer Science Journal of Moldova, 7 (1999) no. 1, pp. 3–17.
- [17] G. Peters, and J.H. Wilkinson, Inverse iteration, ill-conditioned equations and Newton’s method, SIAM Review, 21 (1979) no. 3, pp. 339–360.
- [18] M.C. Santos, A note on the Newton iteration for the algebraic eigenvalue problem, SIAM J. Matrix Anal. Appl., 9 (1988) no. 4, pp. 561–569.
- [19] R.A. Tapia and L.D. Whitley, The projected Newton method has order for the symmetric eigenvalue problem, SIAM J. Numer. Anal., 25 (1988) no. 6, pp. 1376–1382.
- [20] F. Tisseur, Newton’s method in floating point arithmetic and iterative refinement of generalized eigenvalue problems, SIAM J. Matrix Anal. Appl., 22 (2001) no. 4, pp. 1038–1057.
- [21] K. Wu, Y. Saad, and A. Stathopoulos, Inexact Newton preconditioning techniques for large symmetric eigenvalue problems, Electronic Transactions on Numerical Analysis, 7 (1998) pp. 202–214.
- [22] T. Yamamoto, Error bounds for computed eigenvalues and eigenvectors, Numer. Math., 34 (1980), pp. 189–199.