On approximating the eigenvalues and eigenvectors of linear continuous operators

Abstract

We consider the computing of an eigenpair (an eigenvector \(v=(v^{(i)})_{i=1,n}\) and an eigenvalue \(\lambda\)) of a matrix \(A\in\mathbb{R}^{n\times n}\), by considering a supplementary condition (we call it norming function for the eigenvector), represented by a polynomial of degree 2. A usual choice is
\begin{equation}
G(v):={\textstyle\frac12} \sum_{i=1}^n( v^{(i)})^2-1=0.
\end{equation}
We propose here a new choice:
\begin{equation}
G(v):={\textstyle\frac1{2n}} \sum_{i=1}^n( v^{(i)})^2-1=0,
\end{equation}
which has the advantage that leads to a smaller nonlinearity.

Indeed, for the \(n+1\)-dimensional nonlinear system (a polynomial equation of degree 2) we obtain:
\[
F\left( x\right) :={{Av-\lambda v} \choose {G(v)-1}}
=0,
\]
and our proposed choice leads to a second derivative of \(F\) that has norm 2 (compared to \(n\), for the usual choice).

We consider this problem in a general setting, of a linear continuous operator \(A:V\rightarrow V\), \(V\) Banach space, which leads to a polynomial equation of degree two.

We study the semilocal convergence of an iterative method of Schultz type for this problem; this method has the advantage that does not require the solving of a linear system at each iteration step:
\begin{align*}
x_{k+1} =&x_k-\Gamma_kF\left( x_k\right) \\
\Gamma_{k+1} =&\Gamma_k\left( 2I-F^{\prime }\left( x_{k+1}\right) \Gamma_k\right) , \qquad k=0,1,\ldots,
\end{align*}
where \(x_0\in X\), \(\Gamma_0\in \mathcal{L}\left( X\right)\), and \(I\) is the identity operator of \(\mathcal{L}\left( X\right)\).

We obtain semilocal convergence conditions which show that the method has r-convergence order 2.

Authors

Emil Cătinaş
(Tiberiu Popoviciu Institute of Numerical Analysis)

Ion Păvăloiu
(Tiberiu Popoviciu Institute of Numerical Analysis)

Keywords

linear continuous operator; Banach space; Newton type method; eigenvector; eigenvalue; eigenpair; Schultz method; r-convergence order.

Cite this paper as:

E. Cătinaş, I. Păvăloiu, On approximating the eigenvalues and eigenvectors of linear continuous operators, Rev. Anal. Numér. Théor. Approx., 26 (1997) nos. 1-2, pp. 19-27.

PDF

Scanned paper: on the journal website.

Latex-pdf version of the paper. (soon)

About this paper

Print ISSN

1222-9024

Online ISSN

?

MR

?

ZBL

2457-8126

Google Scholar citations

[1] M.P. Anselone, L.B. Rall, The solution of characteristic value-vector problems by Newton method, Numer. Math. 11 (1968), 38–45.
CrossRef

[2] E. Catinas, I. Pavaloiu, On the Chebyshev method for approximating the eigenvalues of linear operators, Rev. Anal. Numer. Theor. Approx. 25 (1996) nos. 1–2, pp. 43–56.
article post,   article on the journal website

[3] P.G. Ciarlet, Introduction a l’analyse numerique matricielle et a l’optimisation, Mason, Paris, 1990.

[4] F. Chatelin, Valeurs propres de matrices, Mason, Paris, 1988.

[5] L. Collatz, Functionalanalysis und Numerische Mathematik, Springer-Verlag, Berlin, 1964.

[6] A. Diaconu, On the convergence of an iterative proceeding of Chebyshev type, Rev. Anal. Numer. Theor. Approx. 24 (1995) nos. 1–2, pp. 91–102.
article on the journal website

[7] A. Diaconu, I. Pavaloiu, Sur quelque methodes iteratives pour la resolution des equations operationelles, Rev. Anal. Numer. Theor. Approx. 1 (1972) no. 1, pp. 45–61.
article on the journal website

[8] V.S. Kartısov, F.L. Iuhno, O nekotorıh Modifikatiah Metoda Niutona dlea Resenia Nelineinoi Spektralnoi Zadaci, J. Vıcisl. matem. i matem. fiz. 33 (1973) 9, pp. 1403–1409.

[9] I. Lazar, On a Newton type method, Rev. Anal. Numer. Theor. Approx. 23 (1994) no. 2, pp. 167–174.
article on journal website

[10] I. Pavaloiu, Observations concerning some approximation methods for the solutions of operator equations, Rev. Anal. Numer. Theor. Approx. 23 (1994) no. 2, pp. 185–196.
article on the journal website

[11] I. Pavaloiu, Sur les procedes iteratifs a un ordre eleve de convergence, Mathematica (Cluj) 12 (35) (1970) no. 2, pp. 309–324.
post

[12] R.A. Tapia, L.D. Whitley, The projected Newton method has order 1+√2 for the symmetric eigenvalue problem, SIAM J. Numer. Anal. 25 (1988) no. 6, pp. 1376–1382.
CrossRef

[13] F.J. Traub, Iterative Methods for the Solution of Equations, Prentice-Hall Inc., Englewood Cliffs, N. J., 1964.

[14] S. Ul’m, On the iterative method with simultaneous approximation of the inverse of the operator, Izv. Acad. Nauk. Estonskoi S.S.R. 16 (1967) no. 4, pp. 403–411.

[15] T. Yamamoto, Error bounds for computed eigenvalues and eigenvectors, Numer. Math. 34 (1980), pp. 189–199.
CrossRef

Paper (preprint) in HTML form

On approximating the eigenvalues and eigenvectors of linear continuous operators

On approximating the eigenvalues and eigenvectors of linear continuous operators

Emil Cătinaş and Ion Păvăloiu
1991 AMS Subject Classification: 65J20, 65H17.

1. Introduction

One of the difficulties that appear when solving numerically the operatorial equations by iterative methods having high convergence orders is that at each iteration step there must be solved a linear operatorial equation, or, in some cases, even more than one [3].

In a series of papers ([7], [8], [10], [15]) there has been proposed the elimination of this inconvenience by the simultaneous generation of two sequences: a sequence approximating the solution, and a sequence of linear operators approximating the inverse of the linear operator appearing at each step in the linear equation.

In the present paper we shall study this approach when the solutions of the equation yield eigenvalues and eigenvectors of a linear operator. It is well known that all the derivatives of order higher than three of the attached operator are the null multilinear operators. The convergence results may also be applied to polynomial operator equations of degree two.

The r convergence order of the sequence approximating the solution is proved to be 2.

The operatorial equation which lead us to the approximation of the eigenvalues and eigenvectors of a linear operator can be constructed in the following way (see [6]):

Let V be a Banach space over the field 𝕂 (where 𝕂= or 𝕂=); denote by (V) the set of linear continuous operators acting from V into V and let A(V). The scalar λ𝕂 is an eigenvalue of A if the equation

(1) Avλv=θ

has at least a solution vθ, called an eigenvector of A corresponding to λ, where θ is the null element of V.

For the determination of an eigenpair (v,λ) we also consider another equation

(2) G(v)1=0,

where G:V𝕂 is a polynomial functional of degree at most two (a norming function) for which G(0)1.

Remark.

The functional G may also be taken as a linear continuous functional, but in this case, if dimV=n, then dimkerG=n1, so there exist eigenvectors which do not fulfill equation (2). ∎

Denote the Banach space X=V×𝕂 and for x=(vλ), vV, λ𝕂 define

x=max{v,|λ|}.

Considering the operator F:XX given by

F(x)=(AvλvG(v)1)=((AλI)vG(v)1),

and denoting by θ¯=(θ0) the null element of X, then the operatorial equation for which a solution yields an eigenpair of A is

(3) F(x)=θ¯.

It is known that the Fréchet derivatives of F are (see [6]):

F(x0)h=(Aλ0Iv0G(v0)0)(uα)=(Auλ0uαv0G(v0)u),

and

F′′(x0)hk=(αwβuG′′uw),

where x0=(v0λ0), h=(uα), k=(wβ)X.

It is obvious that F(i)(x0)h1hi=θ¯, for all i3 and x0,h1,,hiX, and also that F′′=max{2,G′′}.

For such an operator the following identity holds:

(4) F(y)=F(x)+F(x)(yx)+F′′(x)(yx)2,x,yX,

where the bilinear operator F′′ does not depend on x.

We shall consider two sequences (xk)k0, (Γk)k0 having elements from X, resp. (X), using the following iterative method:

(5) xk+1 = xkΓkF(xk)
Γk+1 = Γk(2IF(xk+1)Γk),k=0,1,,

where x0X, Γ0(X), and I is the identity operator of (X).

We call (5) the combined Newton method. In the following sections we shall study its convergence when F is a polynomial operator of degree 2 and we shall apply it for the approximation of the eigenvalues and eigenvectors of matrices.

2. The convergence of the combined Newton method

For the study of the convergence of the method (5) we shall use the following lemma:

Lemma 1.

If the sequences (δk)k0 and (ρk)k0 of real positive numbers satisfy the following conditions

δk+1 (δk+2ρk)2
ρk+1 ρkδk+ρk2,k=0,1,

where max{δ0,ρ0}19d, for some d<1, then the following relations hold:

δk 19d2k,
ρk 19d2k,k=0,1,

The proof of this lemma is immediately obtained by induction.

Let x0X, Γ0(X) and S={xX|xx0r}, r>0. Suppose that the following estimation holds:

F′′(x)K,xS.

The following theorem holds.

Theorem 2.

If x0S, Γ0(X), r and F satisfy the following conditions

  • a)

    there exists F(x0)1 and b0=F(x0)1;

  • b)

    q=Kb0r<1;

  • c)

    max{δ0,ρ0}19d, for some d<1, where

    δ0 =IF(x0)Γ0,
    ρ0 =5081b2KF(x0),and
    b =b01q;
  • d)

    d5K(1q)r,

then the following properties hold:

  • 1)

    the sequences (xk)k0, (Γk)k0 generated by (5) converge, and xkS for all k0;

  • 2)

    denoting x=limkxk and Γ=limkΓk, then F(x)=θ¯ and Γ=F(x)1;

  • 3)

    the following relations are true:

    xxk d2k5bK(1d2k),k=0,1,;
    ΓΓk d2k3(1d2k),k=0,1,
Proof.

At first we shall show that for any xS there exists F(x)1 and F(x)1b.

Indeed, under the above assumptions, it easily follows that

IΓ0F(x)Kb0r=q<1.

Applying the Banach lemma we get

F(x)1b01q=b.

Taking into account a) and b) it follows that

(6) Γ0F(x0)1(F(x0)Γ0I+1)b0(1+δ0)109b0109b,

which, together with the first relation from (5), for k=0, imply

x1x0Γ0F(x0)1081bd9950b2K<d5bK(1d)r,

i.e. x1S.

Denote ρ1=5081b2KF(x1) and δ1=IF(x1)Γ1. An elementary reasoning shows that

ρ1 ρ02+δ0ρ0
δ1 (δ0+2ρ0)2,

whence, by the above Lemma and by relation c) we infer that

ρ1 19d2
δ1 19d2.

Suppose now that the following relations hold:

α) x1,,xkS;

β) δi=IF(xi)Γi19d2i, ρi=5081b2KF(xi)19d2i, i=0,k¯;

γ) xixi1d2i5bK, i=1,k¯.

We shall show that they also hold for k+1.

The inequality

Γk109b

is proved similarly to (2.2). Using also the second relation from (5) we get

xk+1xkΓkF(xk)d2k5bK,

i.e. the relation γ) for i=k+1.

Further,

xk+1x0i=0kxi+1xi156Ki=0kd2k<d5Kb(1d)r,

whence it follows that xk+1S.

Denoting ρk+1=5081b2KF(xk+1) and δk+1=IF(xk+1)Γk+1, then

ρk+1 ρk2+ρkδk
δk+1 (δk+ρk)2,

whence, by our Lemma we get

ρk+1 19d2k+1
δk+1 19d2k+1,

i.e. the relation β) for i=k+1.

It is obvious that xiS for all i=1,2, and the relations β) and γ) hold for all k.

From the inequalities

xk+mxki=kk+m1xi+1xid2k5Kb(1d2k),m=1,2,

it follows that the sequence (xk)k0 converges. Denoting x=limkxk then from the last relation for m we get

xxkd2k5Kb(1d2k),k=0,1,

From the second relation of (5) it follows that

Γk+1Γk =IF(xk+1)Γk
IF(xk)Γk+F(xk)F(xk+1)Γk
δk+Γk2KF(xk)
δk+2ρk13d2k.

The previous inequality implies that the sequence (Γk)k0 converges and the relations 2) and the second inequality in 3) hold. ∎

3. The approximation of eigenvalues and eigenvectors of matrices

In the following we shall apply the studied method for the approximation of the eigenvalues and eigenvectors of complex matrices.

Let A=(aij)i,j=1,nn(𝕂) be a square matrix with the elements ai,j𝕂. Consider V=𝕂n and X=𝕂n+1. In this case the equation (3) is written

Fi(x)=Fi(x(1),,x(n+1))=0,i=1,n+1¯,

where

Fi(x)=ai1x(1)++ai,i1x(i1)+(aiix(n+1))x(i)+ai,i+1x(i+1)++ainx(n),

i=1,n¯.

For the norming function we can take G=Fn+1, where

(7) Fn+1(x)=12i=1n(x(i))21.

The first and second order derivatives of F are given by

F(x)h=(a11x(n+1)a12a1nx(1)a21a22x(n+1)a2nx(2)an1an2annx(n+1)x(n)x(1)x(2)x(n)0)(h(1)h(2)h(n)h(n+1)),

and

F′′(x)hk=(k(n+1)00k(1)0k(n+1)0k(2)00k(n+1)k(n)k(1)k(2)k(n)0)(h(1)h(2)h(n)h(n+1)).

where x=(x(1),,x(n+1)),h=(h(1),,h(n+1)),k=(k(1),,k(n+1))𝕂n+1.

Suppose that 𝕂n+1 is equipped with the max-norm. Then, from the above formula it follows that F′′(x)=n, for all x𝕂n+1.

Another possible choice for the norming function G is

(8) Fn+1(x)=12ni=1n(x(i))21.

in which case we get F′′(x)=2, for all x𝕂n+1.

The Theorem stated in the previous section can be reformulated according to this setting.

Remark.

In [16] it is proved that for a given eigenpair (v,λ) the operator F(v,λ) is nonsingular iff λ is simple. Hence our result applies only for such eigenvalues.

4. Numerical example

Consider the real matrix

A=(110.5110.250.50.252)

which has the following eigenvalues and eigenvectors

λ1=0.01664728361v1=(0.7212071298,0.6863492877,0.09372796349)λ2=1.480121423v2=(0.4442810581,0.5621094204,0.6976011330)λ3=2.536525860v3=(0.5314834119,0.4614733520,0.7103293096).

Taking the initial values x0=(0.7,0.6,0.09,0.01), and applying the studied method for G given by (7), we obtain the following results:

k x1 x2 x3 x4=λ
0 0.7 0.6 0.09 0.01
1 0.724 175 907 5 0.689 434 334 6 0.094 069 599 84 0.016 114 176 48
2 0.721 237 913 5 0.686 375 347 9 0.093 732 538 57 0.016 634 900 68
3 0.721 207 134 0 0.686 349 290 8 0.093 727 964 20 0.016 647 279 74
4 0.721 207 129 8 0.686 349 287 7 0.093 727 963 50 0.016 647 283 61

For the initial values x0=(1.7,1.6,0.2,0.01), and taking G given by (8) we obtain:

k x1 x2 x3 x4=λ
0 1.7 1.6 0.2 0.01
1 1.768 398 012 1.682 966 665 0.229 883 578 0 0.016 956 741 74
2 1.766 594 350 1.681 210 330 0.229 586 553 3 0.016 649 009 83
3 1.766 589 467 1.681 205 540 0.229 585 685 2 0.016 647 283 65

References

Romanian AcademyP.O. Box 68 3400 Cluj-Napoca 1Romania

1997

Related Posts