On a Chebyshev-type method for approximating the solutions of polynomial operator equations of degree 2

Abstract

Authors

Keywords

?

Paper coordinates

E. Cătinaş, I. Păvăloiu, On a Chebyshev-type method for approximating the solutions of polynomial operator equations of degree 2, Approximation and Optimization, Proceedings of the International Congress on Approximation and Optimization (Romania)-ICAOR, Cluj-Napoca, July 29-August 1, 1996, vol. I, pp. 219-226, D.D. Stancu, Gh. Coman, W.W. Breckner and P. Blaga (eds.), Transilvania Press, 1997, ISBN 973-98180-7-2.

PDF

About this paper

Journal
Publisher Name
DOI
Print ISSN
Online ISSN

google scholar link

??

Paper (preprint) in HTML form

1. Introduction

1. Introduction

For solving the nonlinear equations, in a recent paper, A. Diaconu [7] has proposed the Chebyshev-type method (1.2), for which the computation of the inverse of the derivative at each step is avoided. Similar methods have been studied by other authors [5], [6], [14], but these does not preserve the r-convergence order 3.

In this note we shall apply method (1.2) for solving polynomial operator equations of degree 2. We shall show that the hypotheses for the convergence of the method take a simplified form, the convergence order remaining unaltered. We shall consider then the eigenproblem for scalar matrices, applying to it the studied method. Numerical examples are also given.

Let X be a Banach space, F:X→X a nonlinear operator and consider the equation

F⁢(x)=θ¯, 1.1

θ¯ being the null element of X.

For solving (1.1) in [7] there are considered three sequences, (xk)k≥0⊂X and (Bk)k≥0, (Ck)k≥0⊂ℒ⁢(X) given by

Ck =Bk⁢(2⁢I−F′⁢(xk)⁢Bk) 1.2
xk+1 =xk−Ck⁢F⁢(xk)−12⁢Ck⁢F′′⁢(xk)⁢(Ck⁢F⁢(xk))2
Bk+1 =Bk⁢[3⁢I−3⁢F′⁢(xk+1)⁢Bk+(F′⁢(xk+1)⁢Bk)2],k=0,1,…,

where x0∈X and B0∈ℒ⁢(X), ℒ⁢(X) being the set of all linear continuous operators on X and I∈ℒ⁢(X) being the identity operator.

Remark. The convergence with r-order 3 of this method is obtained despite a general principle which suggests that every newly computed unknown should be used at once in the determination of the other unknowns (e.g. the Gauss-Seidel method for linear systems). In our case we could consider Ck instead of Bk in the determination of Bk+1.

2. The convergence of the method

We shall give first a lemma.

Lemma

If the sequences of real positive numbers (δk)k≥0 and (ρk)k≥0 satisfy

δk+1 ≤(δk+2⁢ρk+2⁢ρk2)3
ρk+1 ≤ρk⁢δk2+ρk2⁢δk2+2⁢ρk3+ρk4,k=0,1,…,

where max⁡{δ0,ρ0}≤17⁢d for some 0<d<1,

then the following relation holds:

max⁡{δk,ρk}≤17⁢d3k,k=0,1,….

The proof can be easily obtained by induction.

In the following we shall study the convergence of method (1.2) supposing that F is a polynomial operator of degree 2, i.e. F is indefinite differentiable on X and F(i)=θi for i≥3, θi being the i-linear null operators.

Under this condition F satisfies

F⁢(y)=F⁢(x)+F′⁢(x)⁢(y−x)+12⁢F′′⁢(x)⁢(y−x)2,for all ⁢x,y∈X, 2.1

where, in fact, F′′⁢(x) is a constant bilinear operator which does not depend on x.

Let x0∈X and r,K>0 be two real numbers. Denote S={x∈X|‖x−x0‖≤r} and suppose that we have the estimation

‖F′′⁢(x)‖≤K,for all ⁢x∈S.

Concerning the convergence of method (1.2), the following result holds:

Theorem

If the operator F and the elements x0∈X, B0∈ℒ⁢(X) satisfy:

a) there exists F′⁢(x0)−1 and ‖F′⁢(x0)−1‖≤b0 for some b0>0;

b) q=K⁢b0⁢r<1;

c) max⁡{δ0,ρ0}≤17⁢d for some 0<d<1, where

ρ0=K⁢a22⁢‖F⁢(x0)‖,δ0=‖I−F′⁢(x0)⁢B0‖,a=6449⁢b⁢ andb=b01−q;

d) 16⁢d49⁢K⁢a⁢(1−d2)≤r,

then the following properties hold:

1) the sequences (xk)k≥0, (Bk)k≥0, (Ck)k≥0 converge and (xk)k≥0⊂S;

2) denoting x∗=limxk,B=limBk,C=limCk, then F⁢(x∗)=θ¯ and B=C=F′⁢(x∗)−1;

3) the following estimations are true:

‖x∗−xk‖ ≤16⁢d3k49⁢K⁢a⁢(1−d2⋅3k);
‖B−Bk‖ ≤1656⁢a⁢d3k2401⁢(1−d2⋅3k),k=0,1,…
Demonstration Proof

We shall prove firstly that the first order derivative of F is invertible on S. By a) and b) we have

‖I−F′⁢(x0)−1⁢F′⁢(x)‖≤‖F′⁢(x0)−1‖⁢‖F′⁢(x0)−F′⁢(x)‖≤b0⁢K⁢r=q<1,

for all x∈S. It follows that the operator T⁢(x)=F′⁢(x0)−1⁢F′⁢(x) is invertible on S and T⁢(x)−1=F′⁢(x)−1⁢F′⁢(x0), whence F′⁢(x)−1=T⁢(x)−1⁢F′⁢(x0)−1 and

‖F′⁢(x)−1‖≤b01−q=b.

For the norms of B0 and C0, taking into account the hypotheses, we get

‖B0‖≤ ‖B0−F′⁢(x0)−1‖+‖F′⁢(x0)−1‖
≤ ‖F′⁢(x0)−1‖⁢(1+‖I−F′⁢(x0)⁢B0‖)
≤ b0⁢(1+δ0)≤87⁢b0<87⁢b

and

‖C0‖≤‖B0‖+‖I−F′⁢(x0)⁢B0‖⋅‖B0‖≤‖B0‖⁢(1+δ0)≤6449⁢b=a,

so ‖B0‖≤a and ‖C0‖≤a.

From (1.2) we have

‖x1−x0‖≤ a⁢(1+K⁢a22⁢‖F⁢(x0)‖)⁢‖F⁢(x0)‖
≤ a⁢(1+ρ0)⁢‖F⁢(x0)‖
< 87⁢a⁢‖F⁢(x0)‖=2⁢ρ0K⁢a2⋅87⁢a=16⁢d49⁢K⁢a,

whence, taking into account d) it follows that x1∈S.

Further, by (1.2) and (2.1),

‖F⁢(x1)‖≤ ‖I−F′⁢(x0)⁢C0‖⁢(1+12⁢‖F′′⁢(x0)‖⁢‖C0‖2⁢‖F′⁢(x0)‖)⁢‖F⁢(x0)‖
+12⁢‖F′′⁢(x0)‖2⁢‖C0‖4⁢‖F⁢(x0)‖3+18⁢‖F′′⁢(x0)‖3⁢‖C0‖6⁢‖F⁢(x0)‖4,

whence

K⁢a22⁢‖F⁢(x1)‖≤ K⁢a22⁢‖F⁢(x0)‖⋅‖I−F′⁢(x0)⁢C0‖⁢(1+K⁢a22⁢‖F⁢(x0)‖)
+2⁢(K⁢a22⁢‖F⁢(x0)‖)3+(K⁢a22⁢‖F⁢(x0)‖)4.

Denoting ρ1=K⁢a22⁢‖F⁢(x1)‖ and taking into account the inequality

‖I−F′⁢(x0)⁢C0‖≤‖I−F′⁢(x0)⁢B0‖2=δ02

it follows

ρ1≤ρ0⁢δ02+ρ02⁢δ02+2⁢ρ03+ρ04. 2.2

From the third relation of (1.2) we get

‖I−F′⁢(x1)⁢B1‖= ‖(I−F′⁢(x1)⁢B0)3‖
≤ ‖I−F′⁢(x1)⁢B0‖3≤
≤ (‖I−F′⁢(x0)⁢B0‖+‖B0‖⁢K⁢‖x1−x0‖)3
≤ (δ0+2⁢ρ0+2⁢ρ02)3,

i.e.,

δ1≤(δ0+2⁢ρ0+2⁢ρ02)3. 2.3

By (2.2),(2.3) and hypothesis b), we obtain

ρ1≤17⁢d3δ1≤17⁢d3.

Suppose now that the following properties hold:

𝜶 ) x0,x1,…,xk∈S;

𝜷) ρi:=K⁢a22⁢‖F⁢(xi)‖≤17⁢d3i and δi:=‖I−F′⁢(xi)⁢Bi‖≤17⁢d3i,i=0,k¯.

It easily follows that ‖Bk‖≤a, ‖Ck‖≤a and

‖xk+1−xk‖≤ a⁢(1+K⁢a22⁢‖F⁢(xk)‖)⁢‖F⁢(xk)‖ 2.4
≤ a⁢(1+ρk)⁢‖F⁢(xk)‖
≤ 16⁢ρk7⁢K⁢a≤16⁢d349⁢K⁢a.

From the above formula it follows that xk+1∈S:

‖xk+1−x0‖≤16⁢d49⁢K⁢a⁢∑i=0kd3i−1≤16⁢d49⁢K⁢a⁢(1−d2)≤r.

Denoting ρk+1=K⁢a22⁢‖F⁢(xk+1)‖ and δk+1=‖I−F′⁢(xk+1)⁢Bk+1‖, the following relations are obtained in the same manner as for ρ1 and δ1:

ρk+1 ≤ρk⁢δk2+ρk2⁢δk2+2⁢ρk3+ρk4
δk+1 ≤(δk+2⁢ρk+2⁢ρk2)3,

whence, by the Lemma, we get

ρk+1≤17⁢d3k+1δk+1≤17⁢d3k+1. 2.5

Then properties 𝜶), 𝜷), (2.4) and (2.5) hold for all k∈ℕ. We shall prove now that (xk)k≥0 is a Cauchy sequence.

Indeed,

‖xk+s−xk‖≤16⁢d3k49⁢K⁢a⁢∑i=kk+s−1d3s−3k≤16⁢d3k49⁢K⁢a⁢(1−d2⋅3k),

for all s,k∈ℕ, which proves that (xk)k≥0 converges. Denoting x∗=limk→∞xk and passing to limit for s→∞ in the above inequality, we obtain

‖x∗−xk‖≤16⁢d3k49⁢K⁢a⁢(1−d2⋅3k),k=0,1,…

The convergence of (Bk)k≥0 is obtained from the third relation of (1.2):

‖Bk+1−Bk‖≤ ‖Bk‖⋅‖2⁢I−F′⁢(xk+1)⁢Bk‖⋅‖I−F′⁢(xk+1)⁢Bk‖
≤ a⁢(1+δk+2⁢ρk+2⁢ρk2)⁢(ρk+2⁢ρk+2⁢ρk2)≤a⁢16562401⁢d3k.

Denoting B=limBk it easily follows that

‖B−Bk‖≤1656⁢a⁢d3k2401⁢(1−d2⋅3k),k=0,1,…∎

Remark. The inequalities from the hypothesis of the Lemma can be replaced by δ0≤α⁢d,ρ0≤β⁢d for 0<d<1 and α,β>0 satisfying (α+2⁢β+2⁢β2⁢d)3≤α and β⁢α2+β2⁢α2+2⁢β3+β4⁢d≤β.

We shall obviously obtain in the conclusion that δk≤α⁢d3k,ρk≤β⁢d3k,k=0,1,…. The theorem can be reformulated then accordingly. ∎

3. The eigenproblem for linear continuous operators

3.1. The infinite dimensional case

Let V be a Banach space over the field 𝕂 (where 𝕂=ℂ or 𝕂=ℝ) and A:V→V a linear continuous operator. The scalar λ∈𝕂 is an eigenvalue of A iff the equation

A⁢v−λ⁢v=θ 3.1

has at least a solution v∗≠θ, called an eigenvector of A corresponding to λ, where θ is the null element of V.

For the simultaneous determination of a v∗ and a λ we attach to equation (3.1) another equation

G⁢(v)=1, 3.2

where G:V→𝕂 is a polynomial functional of degree two for which G⁢(0)≠1 (a norming function).

Remark. The functional G may also be taken as a polynomial functional of degree one, i.e. a linear continuous functional, but then dimKer⁡G=dimV−dimIm⁡G=n−1, for the finite dimensional case, and dimKer⁡G=∞ otherwise. So, there exist eigenvectors which do not fulfill equation (3.2). ∎

Denote the Banach space X=V×𝕂 and for x=(vλ), with v∈V and λ∈𝕂, define

‖x‖=max⁡{‖v‖,|λ|}.

Considering the operator F:X→X given by

F⁢(x)=(A⁢v−λ⁢vG⁢(v)−1)=((A−λ⁢I)⁢vG⁢(v)−1),

and denoting by θ¯=(θ0) the null element of X, then the operatorial equation for which the solution yields an eigenvalue and an eigenvector of A is

F⁢(x)=θ¯. 3.3

It is known that the Fréchet derivatives of F are (see [4]):

F′⁢(x0)⁢h1= (A−λ0⁢I−v0G′⁢(v0)0)⁢(u1α1)=(A⁢u1−λ0⁢u1−α1⁢v0G′⁢(v0)⁢u1),
F′′⁢(x0)⁢h1⁢h2= (−α1⁢u2−α2⁢u1G′′⁢(v0)⁢u1⁢u2),

where x0=(v0λ0), h1=(u1α1),h2=(u2α2) with v0, u1,u2∈V and λ0,α1,α2∈𝕂.

It is obvious that F(i)⁢(x0)⁢h1⁢…⁢hi=θ¯, for all i≥3 and x0,h1,…,hi∈X.

Our theorem can be applied for this function F and we can take K=max⁡{2,‖G′′‖}.

3.2. The eigenproblem for complex matrices

In the following we shall apply the studied method for the approximation of the eigenvalues and eigenvectors of complex matrices.

Let A=(ai⁢j)i,j=1,n∈ℳn⁢(𝕂) be a square matrix with the elements ai⁢j∈𝕂. Consider V=𝕂n and X=V×𝕂=𝕂n+1. In this case the equation (3.3) is written

Fi⁢(x)=Fi⁢(x(1),…,x(n+1))=0,i=1,n+1¯,

where for i=1,n¯ we have

Fi⁢(x)=ai⁢1⁢x(1)+…+ai,i−1⁢x(i−1)+(ai⁢i−x(n+1))⁢x(i)+ai,i+1⁢x(i+1)+…+ai⁢n⁢x(n),

and for the norming function G we can take

Fn+1⁢(x(1),…,x(n+1))=12⁢∑i=1n(x(i))2−1. 3.4

A solution x∗ of equation F⁢(x)=θ¯ yields an eigenvalue λ=x∗(n+1) and a corresponding eigenvector v∗=(x∗(1),…,x∗(n)) of the matrix A.

The first and second order derivatives of F are given by

F′⁢(x)⁢h=(a11−x(n+1)a12…a1⁢n−x(1)a21a22−x(n+1)…a2⁢n−x(2)⋮⋮⋮⋮an⁢1an⁢2…an⁢n−x(n+1)−x(n)x(1)x(2)…x(n)0)⁢(h(1)h(2)⋮h(n)h(n+1)),

and

F′′⁢(x)⁢h⁢k=(−k(n+1)0…0−k(1)0−k(n+1)…0−k(2)⋮⋮⋮⋮00…−k(n+1)−k(n)k(1)k(2)…k(n)0)⁢(h(1)h(2)⋮h(n)h(n+1)). 3.5

where x=(x(1),…,x(n+1)),h=(h(1),…,h(n+1)),k=(k(1),…,k(n+1))∈𝕂n+1.

Suppose that 𝕂n+1 is equipped with the norm

‖x‖=max1≤i≤n+1⁡|x(i)|,x=(x(1),…,x(n+1))∈𝕂n+1.

Then, from (3.5) it follows that we can take K=‖F′′‖=n. Our theorem can be stated accordingly.

Another possible choice for the definition of Fn+1, is:

Fn+1⁢(x(1),…,x(n+1))=12⁢n⁢∑i=1n(x(i))2−1, 3.6

in which case we can take K=‖F′′‖=2. In this case K does not depend on n.

Remark. In [15] it is proved the following result. If (v,λ) is an eigenpair then F′⁢(v,λ) is nonsingular iff λ is simple. Hence our results apply only for simple eigenvalues.

4. Numerical examples

Consider

A=(111111−1−11−11−11−1−11),

having the eigenvalues and the corresponding eigenvectors λ1,2,3=2, v1=(1,0,0,1), v2=(1,0,1,0), v3=(1,1,0,0), λ4=−2, v4=(−1,1,1,1).

Taking x0=(−1,3,1,3,−1.5), B0=F′⁢(x0)−1 and using formula (3.4) for Fn+1 we get:

kxk(1)xk(2)xk(3)xk(4)xk(5)0−0.30000000001.0000000000.30000000001.000000000−1.7000000001−0.63449246270.67570481400.63449246270.6757048140−1.9011152972−0.70662643750.70689822340.70662643750.7068982234−1.9987733473−0.70710677050.70710677680.70710677050.7071067768−1.9999999764−0.70710678120.70710678120.70710678120.7071067812−2.000000000

Using formula (3.6) for Fn+1 and taking x0=(−1,1.8,1,1.8,−1.6),B0=F′⁢(x0)−1, we obtain

kxk(1)xk(2)xk(3)xk(4)xk(5)0−1.0000000001.8000000001.0000000001.800000000−1.6000000001−1.3829306421.4055155791.3829306421.405515579−1.9726222482−1.4141851971.4142098351.4141851971.414209835−1.9999758243−1.4142135621.4142135621.4142135621.414213562−2.000000000

References

  • 1 ANSELONE, M. P., RALL, B. L., The solution of characteristic value-vector problems by Newton method, Numer. Math. 11 (1968), 38–45.
  • 2 CIARLET, P.G., Introduction à l’analyse numérique matricielle et à l’optimisation, Mason, 1990.
  • 3 CHATELIN, F., Valeurs propres de matrices, Mason, 1988.
  • 4 COLLATZ, L., Functionalanalysis und Numerische Mathematik, Springer-Verlag, 1964.
  • 5 DIACONU, A, PĂVĂLOIU, I., Sur quelques méthodes iteratives pour la résolution des equations operationelles, Rev. Anal. Numér. Théor. Approx. 1 (1972), no. 1, 45–61.
  • 6 DIACONU, A., Sur quelques méthods itératives combinées, Mathematica 22 (45) (1980), no. 2, 247–261.
  • 7 DIACONU, A., On the convergence of an iterative proceeding of Chebyshev type, Rev. Anal. Numér. Théor. Approx. 24 (1995), no. 1-2, 91–102.
  • 8 KARTÎŞOV, V. S., IUHNO, F. L., O nekotorîh Modifikaţiah Metoda Niutona dlea Resenia Nelineinoi Spektralnoi Zadaci, J. Vîcisl. matem. i matem. fiz. 33 (1973), no. 9, 1403–1409.
  • 9 ORTEGA, J.M., RHEINBOLDT, W.C., Iterative Solutions of Nonlinear Equations in Several Variables, Academic Press, 1970.
  • 10 PĂVĂLOIU, I., Sur les procédés itératifs à un ordre élevé de convergence, Mathematica (Cluj) 12 (35) (1970), no. 2, 309–324.
  • 11 PETERS, G., WILKINSON, J.H., Inverse iteration, ill-conditioned equations and Newton’s method, SIAM Review 21 (1979), no. 3, 339–360.
  • 12 SANTOS, C.M., A note on the Newton iteration for the algebraic eigenvalue problem, SIAM J. Matrix Anal. Appl. 9 (1988), no. 4, 561–569.
  • 13 TRAUB, F. J., Iterative Methods for the Solution of Equations, Prentice-Hall Inc., 1964.
  • 14 ULM, S., Ob iterationnyh metodah s’posledovatel’noi approximacii obratnovo operatora, Izv. Acad. Nauk Estonskoi SSR 16 (1967), no. 4, 403–411.
  • 15 YAMAMOTO, T., Error bounds for computed eigenvalues and eigenvectors, Numer. Math. 34 (1980), 189–199.
1997

Related Posts