Abstract

In this paper we study the convergence of a Newton-Steffensen type method for solving nonlinear equations in R, introduced by Sharma [J.R. Sharma, A composite third order Newton–Steffensen method for solving nonlinear equations, Appl. Math. Comput. 169 (2005), 242–246]. Under simplified assumptions regarding the smoothness of the nonlinear function, we show that the q-convergence order of the iterations is 3. The efficiency index of the method is \(\sqrt[3]{3}\) and is larger than \(I_2=\sqrt{2}\), which corresponds to the Newton method or the Steffensen method. Moreover, we show that if the nonlinear function maintains the same monotony and convexity on an interval containing the solution, and the initial approximation satisfies the Fourier condition, then the iterations converge monotonically to the solution. We also obtain a posteriori formulas for controlling the errors. The numerical examples confirm the theoretical results.

Authors

Ion Păvăloiu
(Tiberiu Popoviciu Institute of Numerical Analysis, Romanian Academy)

Emil Cătinaş
(Tiberiu Popoviciu Institute of Numerical Analysis, Romanian Academy)

Keywords

Nonlinear equations in R; Newton method; Steffensen type methods; inverse interpolatory polynomials; divided differences.

Paper coordinates

I. Păvăloiu, E. Cătinaş, On a Newton-Steffensen type method, Appl. Math. Lett., 26 (2013) no. 6, pp. 659-663
doi: 10.1016/j.aml.2013.01.003

PDF

PDF-LaTeX file (freely available on the journal website).

About this paper
Publisher Name

Elsevier

Print ISSN

0893-9659

Online ISSN

Google Scholar Profile

[1] M.A. Ostrowski, Solution of Equations in Euclidian and Banach Spaces Academic Press, New York and London (1973)

[2] M. Frontini, Hermite interpolation and a new iterative method for the computation of the roots of non-linear equations, Calcolo, 40 (2003), pp. 109-119 View Record in Scopus

[3] I.K. Argyros, A new convergence theorem for the Steffensen method in Banach space and applications, Rev. Anal. Numer. Theor. Approx., 29 (2) (2000), pp. 119-127

[4] S. Amat, J. Blanda, S. Busquier, A Steffensen type method with modified functions, Riv. Mat. Univ. Parma, 7 (2007), pp. 125-133

[5] E. Cătinaș E., On some Steffensen-type iterative methods for a class of nonlinear equations, Rev. Anal. Numer. Theor. Approx., 24 (1-2) (1995), pp. 37-43

[6] A. Cordero, J.R. Torregrosa, A class of Steffensen type methods with optimal order of convergence, Appl. Math. Comput., 217 (2011), pp. 7653-7659

[7] Hongmin Ren, Qingbiao Wu, Weihong Bi, A class of two-step Steffensen type methods with fourth-order convergence, Appl. Math. Comput., 209 (2009), pp. 206-210

[8] P. Jain, Steffensen type method for solving non-linear equations, Appl. Math. Comput., 194 (2007), pp. 527-533

[9] I. Păvăloiu I., Approximation of the root of equations by Aitken–Steffensen-type monotonic sequences, Calcolo, 32 (1995), pp. 69-82

[10] I. Păvăloiu, E. Cătinaș, On a Steffensen type method, Proceedings of SYNASC 2007, 9th International Symposium on Symbolic and Numeric Algoritms for Scientific Computing, Timișoara, Romania, September 26-29, IEEE Computer Society (2007), pp. 369-375

[11] J.R. Sharma, A composite third order Newton–Steffensen method for solving nonlinear equations, Appl. Math. Comput., 169 (2005), pp. 242-246, https://doi.org/10.1016/j.amc.2004.10.040

[12] Quan Zheng, Peng Zhao, Li Zhang, Wenchao Ma, Variants of Steffensen-secant method and applications, Appl. Math. Comput., 216 (12) (2010), pp. 3486-3496

[13] J.F. Traub, Iterative Method for Solution of Equations Prentice-Hall, Englewood Cliffs, New Jersey (1964)

[14] Shaohua Yu, Xiubin Xu, Jianqiu Li, Younghui Ling, Convergence behavior for Newton-Steffensen’s method under Lipschitz condition of second derivative Taiwanese, J. Math., 15 (6) (2011), pp. 2577-2600

Paper (preprint) in HTML form

On a Newton-Steffensen type method

On a Newton-Steffensen type method

I. Păvăloiu and E. Cătinaş ”T. Popoviciu” Institute of Numerical Analysis, Romanian Academy, P.O. Box 68-1, Cluj-Napoca, Romania, e-mail: pavaloiu@ictp.acad.ro,ecatinas@ictp.acad.ro
Abstract

In this paper we study the convergence of a Newton-Steffensen type method for solving nonlinear equations in , introduced by Sharma [J.R. Sharma, A composite third order Newton-Steffensen method for solving nonlinear equations, Appl. Math. Comput. 169 (2005), 242–246].

Under simplified assumptions regarding the smoothness of the nonlinear function, we show that the q-convergence order of the iterations is 3. The efficiency index of the method is 33, and is larger than I2=2, which corresponds to the Newton method or the Steffensen method.

Moreover, we show that if the nonlinear function maintains the same monotony and convexity on an interval containing the solution, and the initial approximation satisfies the Fourier condition, then the iterations converge monotonically to the solution.

We also obtain a posteriori formulas for controlling the errors.

The numerical examples confirm the theoretical results.

keywords:
Nonlinear equations , Newton method , Steffensen method , convergence order.
MSC:
65H05
journal: Applied Mathematical Letters

1 Introduction

Consider the equation

f(x)=0 (1)

f:[a,b], a<b, and another equivalent equation:

xg(x)=0 (2)

g:[a,b][a,b].

The Steffensen type methods are interpolatory methods (see, e.g., [8], [5]), with the nodes controlled at each step by the auxiliary function g [1][4], [6][7], [9][11], [14]. The method generates a sequence {xn}n0 which approximates a solution x of (1):

xn+1=xnf(xn)[xn,g(xn);f],n=0,1,,x0[a,b]. (3)

In the papers [9], [10] is studied the convergence of the Steffensen method when g is given by

g(x)=xλf(x)

λ. The parameter λ is determined such that the sequences {xn}n0 and {g(xn)}n0 approximate bilaterally the solution, and the convergence order of these methods is 2.

In [11] Sharma introduces a Steffensen type method of order three, with g given by

g(x)=xf(x)f(x), (4)

which we shall call as the Newton-Steffensen (N-S) method. Since it requires 3 function evaluations at each iteration step, its efficiency index is I3=33, and is larger than I2=2, which corresponds to the Newton method or the Steffensen method (see, e.g., [9], [8], [12]), and therefore the method is worth to be considered.

In this paper we shall show in Section 2 that the convergence order 3 can be obtained under some weaker smoothness assumptions on f than in [11] and [13]. Moreover, in Section 3 we shall study the convergence of the (N-S) method in hypotheses regarding the monotony and convexity of f on [a,b]. Under some simple assumptions on f, including the Fourier conditions, we shall show that the (N-S) method leads to monotonic sequences which approximate the solution. In Section 4 we illustrate the theory by some numerical examples, which confirm the theoretical results.

2 Local convergence of the method

Consider the following hypotheses:

α) equation (1) has a solution x]a,b[.

β) fC2[a,b],

γ) f(x)0 on [a,b].

Sharma proved the following result.

Theorem 1

[11]If f satisfies α)γ) and moreover, there exists f′′′(x), then the (N-S) method has the q-convergence order at least 3, with the asymptotic constant given by relation:

|xn+1x|=(f′′(x)2f(x))2|xnx|3+o(|xnx|4), as n. (5)

Of course that the fact that the sequence is well defined must be implicitly assumed.

We show that the requirement that f is three times differentiable can be dropped.

In [13], the authors studied the semilocal and local convergence of the (N-S) iterates in the setting of Banach spaces. Local convergence with order 3 was established under the assumption of Lipschitz continuity of f′′. We show here that even the Lipschitz continuity may be relaxed, and we consider the following assumption:

β) fC1[a,b], and f′′(x),x(a,b), which is continuous at x.

Theorem 2

If f satisfies α),β),γ), the (N-S) method is well defined and converges to x, then the method has the q-convergence order at least 3, with the same asymptotic constant given in (5).

Proof. From the Newton identity and α) we have

f(x)= f(xn)+[xn,g(xn);f](xxn)+
+[x,xn,g(xn);f](xxn)(xg(xn))=0

whence, by (3) we get

xxn+1 =[x,xn,g(xn);f][xn,g(xn);f](xxn)(xg(xn)),n=0,1, (6)

By α),β) and the Taylor formula we obtain

f(x)=f(xn)+f(xn)(xxn)+f′′(ξn)2(xxn)2=0, (7)

where ξn belongs to the open interval determined by xn and x.

Taking into account that g(xn)=xnf(xn)f(xn), by (7) we infer

xg(xn)=f′′(ξn)2f(xn)(xxn)2,n=0,1,, (8)

which together with (6) attracts

xxn+1=f′′(ξn)[x,xn,g(xn);f]2f(xn)[xn,g(xn);f](xxn)3,n=0,1,, (9)

which shows that the (N-S) method has q-order 3. The Mean Value Theorem for divided differences ensures that [x,xn,g(xn);f]12f′′(x) and [xn,g(xn);f]f(x), as n, so we are led to the same asymptotic constant as in (5).  

3 Monotone convergence of the method

As it is well known, when fC2[a,b] preserves its monotonicity and convexity on [a,b], if the initial approximation x0[a,b] verifies the Fourier condition, then the Newton method yields a monotone sequence which converges to the solution x[a,b]. We shall show that under same such hypotheses, we obtain the same conclusions, but for a method with superior efficiency index.

We assume that the initial approximation x0 verifies the Fourier condition (see [8]):

δ)

f′′(x0)f(x0)>0,x0[a,b].

We obtain the following results.

Theorem 3

If f and x0 verify α),β),δ) and, moreover,

i1.

f(x)>0, x[a,b];

ii1.

f′′(x)>0,x[a,b],

then the elements of {xn}n0 and {g(xn)}n0 generated by the (N-S) method remain in [a,b], converge to x and obey

xn>g(xn)>xn+1>x,n=0,1,; (10)

Proof. From β) and i1 it follows that x]a,b[ is a unique solution. Conditions α), γ), i1 and ii1 imply that x0>x. Let xn[a,b] such that xn>x. From i1 we get that f(xn)>0 and g(xn)=xnf(xn)f(xn)<xn. Conditions i1, ii1 and (8) imply x<g(xn).

Using the mean value formulas for divided differences and taking into account i1, ii1 and (6), it follows that x<xn+1.

We notice that relation (3) can be written as

xn+1=g(xn)f(g(xn))[xn,g(xn);f],n=0,1,, (11)

whence, since f(g(xn))>0 by i1 it follows xn+1<g(xn).

It is obvious that the elements of {xn}n0 and {g(xn)}n0 belong to ]x,x0][a,b]. It remains to show the convergence to the solution. Indeed, if =limxn then by (10) limg(xn)=g()=, whence f()=0 i.e., =x.  

Theorem 4

The statements of Theorem 3 hold true if assumptions i1, ii1 are replaced by

i2.

f(x)<0, x[a,b];

ii2.

f′′(x)<0, x[a,b].

Proof. The result can be obtained as a consequence of Theorem 3, if instead of (1) we consider the equation h(x)=0, with h=f.  

Theorem 5

If f and x0 verify α),β),δ) and, moreover

i3.

f(x)>0,x[a,b];

ii3.

f′′(x)<0, x[a,b],

then the elements of {xn}n0 and {g(xn)}n0 generated by the (N-S) method remain in [a,b], converge to x and obey

xn<g(xn)<xn+1<x,n=0,1, (12)

Proof. Hypotheses β) and i3 ensure that x[a,b] is a unique solution. Assumptions α), γ), i3 and ii3 lead to f(x0)<0 or x0<x. Let xn<x for some xn[a,b]. By i3 we get f(xn)<0 and g(xn)=xnf(xn)f(xn)>xn. By (8), i3 and ii3 it follows g(xn)<x. Relation (3) implies xn+1>xn and by (6) we get xn+1<x. By (11) we get xn+1>g(xn).  

Theorem 6

The same conclusions hold if in Theorem 5 i3 and ii3 are replaced by

i4.

f(x)<0, x[a,b];

ii4.

f′′(x)>0, x[a,b].

Proof. This result can be obtained from Theorem 5 by taking f instead of f.  

Remark 1

The hypotheses of Theorems 36 ensure the fact that the elements of {xn}n0 and {g(xn)}n0 remain in [a,b]. Since the hypotheses of Theorem 2 are also verified, it follows that the iterations converge with q-order 3.

Remark 2

From relation

f(xn+1)= f(xn)+[xn,g(xn);f](xn+1xn)+
+[xn+1,xn,g(xn);f](xn+1xn)(xn+1g(xn)),

taking into account (3) we get

xxn+1=[xn+1,xn,g(xn);f][x,xn+1;f](xn+1xn)(xn+1g(xn)).

whence it follows that in the assumptions of Theorems 36 we have

|xxn+1|=O(|xn+1xn|2).

This formula can be useful for a posteriori control of the error.

4 Numerical examples

We consider four numerical examples, and we compute the iterations using double precision in Matlab.

Example 1

Consider the equation

f(x)=x2xsinx+ex+13=0,x[0,1].

One can verify that f(0)=e3<0, f(1)=1+e2sin13=e2sin12>0, f(x)=2xsinxxcosx+ex+1>2x+ex+12>0, for all x[0,1]. Also, f′′(x)=22cosx+xsinx+ex+1=4sin2x2+xsinx+ex+1>0 for all x[0,1]. Therefore the assumptions of Theorem 3 apply for x0=1.

We have g(x)=xx2xsinx+ex+132xsinxxcosx+ex+1=x2x2cosx+(x1)ex+1+32xsinxxcosx+ex+1

The obtained numerical results are shown in Table 1. The values of f(xn) are rounded to two decimals, since we are interested only in the magnitude of these values.

n xn g(xn) f(xn)
0 1.000000000000000e+0 4.320688774181047e-1 4.5e+00
1 2.300692760447372e-1 1.070409169425782e-1 4.2e-01
2 9.915547164564892e-2 9.860719010016147e-2 1.6e-03
3 9.860703883247032e-2 9.860703879072202e-2 1.3e-10
4 9.860703879072187e-2 9.860703879072202e-2 -4.4e-16
Table 1: Numerical results for solving x2xsinx+ex+13=0,x[0,1].

It can be seen that the (N-S) method generates decreasing iterates for {xn}n0.

Example 2

Consider the following equation

f(x)=x2+cosxxex=0,x[0,1].

We have: f(0)=1>0, f(1)=e+1+cos1<0, f(x)=2xsinxexxex, f′′(x)=2cosx2exxex<0, f′′′(x)=sinx(3+x)ex, which imply that f(x)<0,f′′(x)<0, x[0,1].

If x0=1, the assumptions of Theorem 4 are verified.

We obtain the results presented in Table 2. As expected, the (N-S) iterates are decreasing.

n xn g(xn) f(xn)
0 1.000000000000000e+0 7.246446975670946e-1 -1.2e+00
1 6.607648584752154e-1 6.395167806664399e-1 -5.3e-02
2 6.391602133769920e-1 6.391540963613613e-1 -1.5e-05
3 6.391540963320078e-1 6.391540963320076e-1 -6.7e-16
Table 2: Numerical results for solving x2+cosxxex=0,x[0,1].
Example 3

Consider

f(x)=sinx+2x2,x[0,π2].

We have f(0)=2<0, f(π2)=π1>0, f(x)=cosx+2>0,x[0,π2], while f′′(x)=sinx<0,x[0,π2].

Taking x0=0, hypothesis of Theorem 5 apply.

The obtained results are presented in Table 3. The (N-S) iterates are increasing.

n xn g(xn) f(xn)
0 0.000000000000000e+0 6.666666666666666e-1 -2.0e+00
1 6.831640060745233e-1 6.840365700507293e-1 -2.4e-03
2 6.840366566692261e-1 6.840366566778295e-1 -2.4e-11
3 6.840366566778295e-1 6.840366566778295e-1 0.0e+00
Table 3: Numerical results for solving sinx+2x2=0,x[0,π2].
Example 4

Consider

f(x)=3exx+1,x[1,2].

We have f(1)=3e>0, f(2)=3e21<0, f(x)=3ex1<0,x[1,2], while f′′(x)=3ex>0,x[1,2].

Taking x0=1, hypothesis of Theorem 6 apply.

The obtained results are presented in Table 4. The (N-S) iterates are increasing.

n xn g(xn) f(xn)
0 1.000000000000000e+0 1.524633113581329e+0 1.1e+00
1 1.593748766088184e+0 1.603527625548530e+0 1.6e-02
2 1.603545706091483e+0 1.603545739535836e+0 5.4e-08
3 1.603545739535836e+0 1.603545739535836e+0 -2.2e-16
Table 4: Numerical results for solving 3exx+1=0,x[1,2].

It is interesting to note that we get f(x3)=0 in Example 3, which suggests that x3=x. However, if instead of the standard double precision we use higher precision (e.g., variable precision arithmetic) for representing x3 from Table 3, the computation of f(x3) no longer yields 0 (of course, we obtain values with the magnitude comparable to the machine epsilon from double precision, ϵ2.22e16). This means that x3 from Table 3 is just a very good approximation (in double precision arithmetic) to the solution.

Acknowledgement. We are grateful to an anonymous referee for his constructive remarks in improving the presentation of our paper.

References

  • [1] I.K. Argyros, A new convergence theorem for the Steffensen method in Banach space and applications, Rev. Anal. Numér. Théor. Approx., 29 (2000) 2 , 119–127.
  • [2] S. Amat, J. Blanda and S. Busquier, A Steffensen type method with modified functions, Rev. Math. Univ. Parma 7 (2007) 125–133.
  • [3] E. Cătinaş, On some Steffensen-type iterative methods for a class of nonlinear equations, Rev. Anal. Numér. Théor. Approx., 24 (1995) nos. 1-2, pp. 37–43.
  • [4] A. Cordero, J.R. Torregrosa, A class of Steffensen type methods with optimal order of convergence, Appl. Math. Comput. 217 (2011), 7653–7659.
  • [5] M. Frontini, Hermite interpolation and a new iterative method for the computation of the roots of non-linear equations, Calcolo, 40 (2003), 109–119.
  • [6] Hongmin Ren, Qingbiao Wu, Weihong Bi, A class of two-step Steffensen type methods with fourth-order convergence, Appl. Math. Comput. 209 (2009), 206–210.
  • [7] P. Jain, Steffensen type method for solving non-linear equations, Appl. Math. Comput. 194 (2007), 527–533.
  • [8] M. A. Ostrowski, Solution of Equations in Euclidian and Banach Spaces, Academic Press, New York and London, 1973.
  • [9] I. Păvăloiu, Approximation of the root of equations by Aitken-Steffensen-type monotonic sequences, Calcolo 32 (1995), 69–82.
  • [10] I. Păvăloiu and E. Cătinas, On a Steffensen type method, IEEE Computer Society, Proceedings of SYNASC 2007, 9th International Symposium on Symbolic and Numeric Algoritms for Scientific Computing, Timişoara, Romania, September 26–29, 2007, pp. 369–375.
  • [11] J. R. Sharma, A composite third order Newton-Steffensen method for solving nonlinear equations, Appl. Math. Comput. 169 (2005), 242–246.
  • [12] J. F. Traub, Iterative Method for Solution of Equations, Prentice-Hall Englewood Cliffs, New Jersey, 1964.
  • [13] Shaohua Yu, Xiubin Xu, Jianqiu Li and Younghui Ling, Convergence behavior for Newton-Steffensen’s method under Lipschitz condition of second derivative, Taiwanese J. Math., 15 (2011) no. 6, 2577–2600.
  • [14] Quan Zheng, Peng Zhao, Li Zhang, Wenchao Ma, Variants of Steffensen-secant method and applications, Appl. Math. Comput. 216 (2010) 12, 3486–3496.
2013

Related Posts