We study the solving of nonlinear equations by an iterative method of Aitken type, which has the interpolation nodes controlled by the Newton method. We obtain a local convergence result which shows that the q-convergence order of this method is 6 and its efficiency index is \(\sqrt[5]6\), which is higher than the efficiency index of the Aitken or Newton methods. Monotone sequences are obtained for initial approximations farther from the solution, if they satisfy the Fourier condition and the nonlinear mapping satisfies monotony and convexity assumptions on the domain.
Authors
Ion Păvăloiu (Tiberiu Popoviciu Institute of Numerical Analysis, Romanian Academy)
Amat, S., Busquier, S.: A two step Steffenssen’s method under modified convergence conditions. J. Math. Anal. Appl. 324, 1084–1092 (2006) ArticleMathSciNetMATHGoogle Scholar
Beltyukov, B.A.: An analogue of the Aitken–Steffensen method with controlled step. URSS Comput. Math. Math. Phys. 27(3), 103–112 (1987) ArticleMathSciNetGoogle Scholar
Chun, C.: A geometric construction of iterative formulas of order three. Appl. Math. Lett. 23, 512–516 (2010) ArticleMathSciNetMATHGoogle Scholar
Cordero, A., Torregrosa, J.R.: Variants of Newton’s method for functions of several variables. Appl. Math. Comput. 183, 199–2008 (2006) ArticleMathSciNetMATHGoogle Scholar
Cordero, A., Torregrosa, J.R.: Variants of Newton’s method using fifth order quadrature formulas. Appl. Math. Comput. 190, 686–698 (2007) ArticleMathSciNetMATHGoogle Scholar
Cordero A., Torregrosa R.J.: A class of Steffenssen type method with optimal order of convergence. Appl. Math. Comput. 217, 7653–7659 (2011) ArticleMathSciNetMATHGoogle Scholar
Hongmin, R., Qingbio, W., Welhong, B.: A class of two-step Steffensen type methods with fourth order convergence. Appl. Math. Comput. 209(2), 206–210 (2009) ArticleMathSciNetMATHGoogle Scholar
Jain, P.: Steffensen type method for solving non-linear equations. Appl. Math. Comput. 194, 527–533 (2007) ArticleMathSciNetMATHGoogle Scholar
Ortega, J.M., Rheinboldt, W.C.: Iterative Solution of Nonlinear Equations in Several Variables. Academic Press, New York (1970) MATHGoogle Scholar
Ostrowski, M.A.: Solution of Equations in Euclidian and Banach Spaces. Academic Press, New York and London (1973) Google Scholar
Păvăloiu, I.: Approximation of the root of equations by Aitken–Steffensen-type monotonic sequences. Calcolo 32, 69–82 (1995) ArticleMathSciNetMATHGoogle Scholar
Păvăloiu, I., Cătinaş, E.: On a Steffensen–Hermite method of order three. Appl. Math. Comput. 215(7), 2663–2672 (2009) ArticleMathSciNetMATHGoogle Scholar
Păvăloiu, I., Cătinaş, E.: On a Steffensen type method. In: Ninth International Symposium on Symbolic and Numeric Algorithms for Scientific Computing, Proceedings, pp. 369–375 (2007)
Păvăloiu, I.: Optimal algorithms, concerning the solving of equations by interpolation. In: Popoviciu, E. (ed.) Research on Theory of Allure, Approximation, Convexity and Optimization, Editura Srima, Cluj-Napoca, pp. 222–248 (1999)
Sharma, R.J.: A composite thid order Newton–Steffensen method for solving nonlinear equations. Appl. Math. Comput. 169, 242–246 (2005) ArticleMathSciNetMATHGoogle Scholar
Traub, Y.F.: Iterative Method for Solution of Equations. Prentice-Hall, Englewood Cliffs, NJ (1964) Google Scholar
Weerakoon, S., Fernando, T.G.I.: A variant of Newton’s method with accelerated third-order convergence. Appl. Math. Lett. 13(8), 87–93 (2000) ArticleMathSciNetMATHGoogle Scholar
Paper (preprint) in HTML form
s11075-012-9577-7
On an Aitken-Newton type method
Ion Păvăloiu • Emil Cătinaş
Abstract
We study the solving of nonlinear equations by an iterative method of Aitken type, which has the interpolation nodes controlled by the Newton method. We obtain a local convergence result which shows that the qq-convergence order of this method is 6 and its efficiency index is root(5)(6)\sqrt[5]{6}, which is higher than the efficiency index of the Aitken or Newton methods. Monotone sequences are obtained for initial approximations farther from the solution, if they satisfy the Fourier condition and the nonlinear mapping satisfies monotony and convexity assumptions on the domain.
In this note we study an Aitken type method, for which the interpolation nodes are given by two iterations of Newton type. We show that this method has the qq-convergence order 6 and it requires 5 function evaluations at each step. This implies that the efficiency index of this method is root(5)(6)\sqrt[5]{6}, which is greater than sqrt2\sqrt{2} (the efficiency index of the Newton and of the Aitken method) [10, 14, 20].
where f:[a,b]rarrR,a < bf:[a, b] \rightarrow \mathbb{R}, a<b and assume alpha)\alpha) this equation has a solution {:x^(**)in]a,b[\left.x^{*} \in\right] a, b[.
We consider two more equations {:[x-g_(1)(x)=0],[(2)x-g_(2)(x)=0]:}\begin{align*}
& x-g_{1}(x)=0 \\
& x-g_{2}(x)=0 \tag{2}
\end{align*} g_(1),g_(2):[a,b]rarr[a,b]g_{1}, g_{2}:[a, b] \rightarrow[a, b], and we assume they are equivalent to (1).
The Aitken method consists in constructing the sequence (x_(n))_(n >= 0)\left(x_{n}\right)_{n \geq 0} given by [1-3, 6-8, 10-19], {:(3)x_(n+1)=g_(1)(x_(n))-(f(g_(1)(x_(n))))/([g_(1)(x_(n)),g_(2)(x_(n));f])","n=0","1","dots","x_(0)in[a","b]",":}\begin{equation*}
x_{n+1}=g_{1}\left(x_{n}\right)-\frac{f\left(g_{1}\left(x_{n}\right)\right)}{\left[g_{1}\left(x_{n}\right), g_{2}\left(x_{n}\right) ; f\right]}, n=0,1, \ldots, x_{0} \in[a, b], \tag{3}
\end{equation*}
where [x,y;f][x, y ; f] stands for the first order divided difference of ff at xx and yy. We suppose that ff is derivable on [a,b][a, b] and we consider the function {:(4)g_(1)(x)=x-(f(x))/(f^(')(x)):}\begin{equation*}
g_{1}(x)=x-\frac{f(x)}{f^{\prime}(x)} \tag{4}
\end{equation*}
which we call the Aitken-Newton method.
In Section 2 we provide a local convergence result for this method, and we show a similar result which holds for the Newton method: if ff maintains its monotony and convexity on a larger domain, and the initial approximation obeys the Fourier condition, then the iterates converge monotonically to the solution. These properties, together with the fact that the efficiency index of this method is shown that is higher than the efficiency index of the Newton or Aitken methods, justify the study of this method.
2 Convergence of the method
We obtain the following local convergence result.
Theorem 1 Assume alpha\alpha ) and beta\beta ) there exists an open interval {:I,x^(**)in I sube]a,b[\left.I, x^{*} \in I \subseteq\right] a, b[ such that ff is two times differentiable on II, with f^('')f^{\prime \prime} continuous at x^(**)x^{*}.
Then there exists an interval J sube IJ \subseteq I such that for any initial approximation x_(0)in Jx_{0} \in J, the iterations (5) are well defined, remain in JJ and converge to x^(**)x^{*} with qq-order at least 6 .
Proof The first and second relations in (5) imply the existence of theta_(n)\theta_{n} and eta_(n)\eta_{n} in the interior of the intervals determined by x_(n)x_{n} and x^(**)x^{*}, resp. y_(n)y_{n} and x^(**)x^{*} such that
which shows the assertion, provided that x_(0)x_{0} is sufficiently close to x^(**)x^{*}.
Under supplementary conditions on ff we obtain the following result.
Theorem 2 If ff and x_(0)x_{0} verify alpha\alpha ), and {:beta^('))quad f\left.\beta^{\prime}\right) \quad f is two times differentiable on [a,b][a, b], with f^('')f^{\prime \prime} continuous at x^(**)x^{*};
γ) quadx_(0)in[a,b]\quad x_{0} \in[a, b] verifies the Fourier condition: f(x_(0))f^('')(x_(0)) > 0f\left(x_{0}\right) f^{\prime \prime}\left(x_{0}\right)>0 (see [10]),
and, moreover, i_(1).quadf^(')(x) > 0,AA x in[a,b];\mathrm{i}_{1} . \quad f^{\prime}(x)>0, \forall x \in[a, b] ;
ii. quadf^('')(x) >= 0,AA x in[a,b]\quad f^{\prime \prime}(x) \geq 0, \forall x \in[a, b],
then the sequences (x_(n))_(n >= 0),(y_(n))_(n >= 0)\left(x_{n}\right)_{n \geq 0},\left(y_{n}\right)_{n \geq 0} and (z_(n))_(n >= 0)\left(z_{n}\right)_{n \geq 0} generated by (5), remain in [ a,ba, b ] and obey j_(1).quadx_(n) > y_(n) > z_(n) > x_(n+1) > x^(**),n=0,1,dots\mathrm{j}_{1} . \quad x_{n}>y_{n}>z_{n}>x_{n+1}>x^{*}, n=0,1, \ldots; jj_(1).quad limx_(n)=limy_(n)=limz_(n)=x^(**)\mathrm{jj}_{1} . \quad \lim x_{n}=\lim y_{n}=\lim z_{n}=x^{*}.
Proof By alpha\alpha ) and i_(1)i_{1} it follows that x^(**)x^{*} is the unique solution of (1). Let {:x_(n)in]a,b[\left.x_{n} \in\right] a, b[ be an approximation which verifies the relation f(x_(n))f^('')(x_(n)) > 0f\left(x_{n}\right) f^{\prime \prime}\left(x_{n}\right)>0. Then by ii_(1)i i_{1} it follows that f(x_(n)) > 0f\left(x_{n}\right)>0, which, together with i_(1)i_{1} lead to x_(n) > x^(**)x_{n}>x^{*}.
From i_(1),ii_(1)i_{1}, i i_{1} and relation (6) we have x^(**)-y_(n) <= 0x^{*}-y_{n} \leq 0, i.e. y_(n) >= x^(**)y_{n} \geq x^{*}. Analogously, from (7) and (8) it follows z_(n) >= x^(**)z_{n} \geq x^{*} and x_(n+1) >= x^(**)x_{n+1} \geq x^{*}.
The first relation in (5) and f(x_(n)) > 0,f^(')(x_(n)) > 0f\left(x_{n}\right)>0, f^{\prime}\left(x_{n}\right)>0 imply that y_(n) < x_(n)y_{n}<x_{n}. Analogously, the second relation in (5) leads to z_(n) < y_(n)z_{n}<y_{n}, while the third relation in (5) to x_(n+1) < z_(n)x_{n+1}<z_{n}. Conclusion j_(1)j_{1} is therefore proved. Moreover, it is clear that the elements of the sequences (x_(n))_(n >= 0),(y_(n))_(n >= 0)\left(x_{n}\right)_{n \geq 0},\left(y_{n}\right)_{n \geq 0} and (z_(n))_(n >= 0)\left(z_{n}\right)_{n \geq 0} remain in the interval [x^(**),x_(0)]sub[a,b]\left[x^{*}, x_{0}\right] \subset[a, b]. By j_(1)j_{1} it follows that these three sequences are convergent.
Let limx_(n)=ℓ\lim x_{n}=\ell. Relation j_(1)j_{1} implies that limy_(n)=limz_(n)=ℓ\lim y_{n}=\lim z_{n}=\ell. The first relation in (5) attracts that ℓ=ℓ-(f(ℓ))/(f^(')(ℓ))\ell=\ell-\frac{f(\ell)}{f^{\prime}(\ell)}, so f(ℓ)=0f(\ell)=0, i.e., ℓ=x^(**)\ell=x^{*}. ◻\square
The following immediate consequence holds.
Corollary 3 If ff and x_(0)in[a,b]x_{0} \in[a, b] verify alpha\alpha ), beta^(')\beta^{\prime} ), gamma\gamma ) and, moreover
i. quadf^(')(x) < 0,AA x in[a,b];\quad f^{\prime}(x)<0, \forall x \in[a, b] ;
ii i _(2)quadf^('')(x) <= 0,AA x in[a,b]_{2} \quad f^{\prime \prime}(x) \leq 0, \forall x \in[a, b],
then the elements of the sequences (x_(n))_(n >= 0),(y_(n))_(n >= 0)\left(x_{n}\right)_{n \geq 0},\left(y_{n}\right)_{n \geq 0}, and (z_(n))_(n >= 0)\left(z_{n}\right)_{n \geq 0} generated by (5) remain in the interval [a,b][a, b] and satisfy the conclusions j_(1)j_{1} and jj_(1)j j_{1} of Theorem 2.
It is easy to see that if instead of (1) we consider
then function h:[a,b]rarrRh:[a, b] \rightarrow \mathbb{R} given by relation
h(x)=-f(x)h(x)=-f(x)
verifies hypothesis of Theorem 2.
Theorem 4 If ff and x_(0)in[a,b]x_{0} \in[a, b] verify {: alpha),beta^(')),gamma\left.\left.\alpha\right), \beta^{\prime}\right), \gamma ) and, moreover, i_(3).quadf^(')(x) > 0,AA x in[a,b];\mathrm{i}_{3} . \quad f^{\prime}(x)>0, \forall x \in[a, b] ;
ii. f^('')(x) <= 0,AA x in[a,b]f^{\prime \prime}(x) \leq 0, \forall x \in[a, b],
then the elements of the sequences (x_(n))_(n >= 0),(y_(n))_(n >= 0)\left(x_{n}\right)_{n \geq 0},\left(y_{n}\right)_{n \geq 0} and (z_(n))_(n >= 0)\left(z_{n}\right)_{n \geq 0} generated by (5) remain in [a,b][a, b] and, moreover, obey j_(3).quadx_(n) < y_(n) < z_(n) < x_(n+1) < x^(**),n=0,1,dots\mathrm{j}_{3} . \quad x_{n}<y_{n}<z_{n}<x_{n+1}<x^{*}, n=0,1, \ldots, ; jj_(3).quad limx_(n)=limy_(n)=limz_(n)=x^(**)\mathrm{jj}_{3} . \quad \lim x_{n}=\lim y_{n}=\lim z_{n}=x^{*}.
The proof of this result is similar to the proof of Theorem 2.
If we replace (1) by (10) then we obtain:
Corollary 5 If ff and x_(0)in[a,b]x_{0} \in[a, b] verify hypothesis alpha\alpha ), beta^(')\beta^{\prime} ), gamma\gamma ) and, moreover, i_(n).quadf^(')(x) < 0,AA x in[a,b];\mathrm{i}_{n} . \quad f^{\prime}(x)<0, \forall x \in[a, b] ; ii_(n).quadf^('')(x) >= 0,AA x in[a,b]\mathrm{ii}_{n} . \quad f^{\prime \prime}(x) \geq 0, \forall x \in[a, b],
then the elements of the sequences (x_(n))_(n >= 0),(y_(n))_(n >= 0)\left(x_{n}\right)_{n \geq 0},\left(y_{n}\right)_{n \geq 0} and (z_(n))_(n >= 0)\left(z_{n}\right)_{n \geq 0} generated by (5) remain in [a,b][a, b] and satisfy the statements j_(3)j_{3} and jj_(3)j j_{3} of Theorem 4.
Remark 6 Relations (9) show us that the Aitken-Newton method has the qq-convergence order at least 6 (it is exactly 6 if f^('')(x^(**))!=0f^{\prime \prime}\left(x^{*}\right) \neq 0, see [9]). In order to obtain x_(n+1)x_{n+1} from x_(n)x_{n} in (5) we need to perform the following function evaluations: f(x_(n)),f^(')(x_(n)),f(y_(n)),f^(')(y_(n))f\left(x_{n}\right), f^{\prime}\left(x_{n}\right), f\left(y_{n}\right), f^{\prime}\left(y_{n}\right) and f(z_(n))f\left(z_{n}\right), i.e., 5 function evaluations. This shows that the efficiency index of this method is root(5)(6)\sqrt[5]{6} which is greater than of Aitken or Newton method.
Remark 7 Under additional information on the bounds of the size of derivatives, one can obtain obtain some a posteriori error estimations of the error:
The mean value formulas for divided differences lead to (11).
These estimations can be applied in connection to any of the results proved above.
3 Numerical examples
Example 8 Consider the equation
f(x)=e^(x)+sin x-2,x in[0,1]f(x)=e^{x}+\sin x-2, x \in[0,1]
The derivatives of ff are given by
{:[f^(')(x)=e^(x)+cos x > 0","quad x in[0","1]],[f^('')(x)=e^(x)-sin x]:}\begin{aligned}
f^{\prime}(x) & =e^{x}+\cos x>0, \quad x \in[0,1] \\
f^{\prime \prime}(x) & =e^{x}-\sin x
\end{aligned}
Some elementary considerations on f^('')f^{\prime \prime} show that f^('')(x) > 0,x in[0,1]f^{\prime \prime}(x)>0, x \in[0,1]. Since ff is continuous, f^(')(x) > 0,x in[0,1]f^{\prime}(x)>0, x \in[0,1] and f(0)=-1,f(1)=e+sin 1-2 > 0f(0)=-1, f(1)=e+\sin 1-2>0, it follows that ff has a unique solution on [0,1][0,1].
Taking x_(0)=1x_{0}=1, the hypotheses of Theorem 2 are satisfied.
Table 1 Numerical results when solving e^(x)+sin x-2=0e^{x}+\sin x-2=0
In Table 1 we present the results obtained in double precision using MATLAB.
One can easily verify that min_(x in[0,1])|f^(')(x)|=2\min _{x \in[0,1]}\left|f^{\prime}(x)\right|=2 and max_(x in[0,1])|f^('')(x)| <= e\max _{x \in[0,1]}\left|f^{\prime \prime}(x)\right| \leq e.
Taking into account (11) we get
The quantity in the right hand side is majorized by 7.0e-277.0 \mathrm{e}-27, which, together with the fact that f(x_(2))=0f\left(x_{2}\right)=0, shows that in this particular case, x^(**)x^{*} can be computed with accuracy higher than the machine epsilon.
Example 9
f(x)=ln(x^(2)+x+2)-x+1=0,x in[4,5].f(x)=\ln \left(x^{2}+x+2\right)-x+1=0, x \in[4,5] .
We have
{:[f^(')(x)=(-x^(2)+x-1)/(x^(2)+x+2) < 0","" for "x in[4","5];],[f^('')(x)=(-2x^(2)-2x+1)/((x^(2)+x+2)^(2)) < 0","" for "x in[4","5];]:}\begin{aligned}
& f^{\prime}(x)=\frac{-x^{2}+x-1}{x^{2}+x+2}<0, \text { for } x \in[4,5] ; \\
& f^{\prime \prime}(x)=\frac{-2 x^{2}-2 x+1}{\left(x^{2}+x+2\right)^{2}}<0, \text { for } x \in[4,5] ;
\end{aligned}
f(4)=ln 22-3 > 0f(4)=\ln 22-3>0 and f(5)=ln 32-4 < 0f(5)=\ln 32-4<0.
We take x_(0)=5x_{0}=5, so hypotheses of Corollary 3 are verified. The obtained results are presented in Table 2.
In this case we have min_(x in[4,5])|f^(')(x)| > (1)/(3)\min _{x \in[4,5]}\left|f^{\prime}(x)\right|>\frac{1}{3} and max_(x in[4,5])|f^('')(x)| <= (1)/(8)\max _{x \in[4,5]}\left|f^{\prime \prime}(x)\right| \leq \frac{1}{8}, whence, by (11) we get
The quantity in the right hand side is majorized by 1.4e-311.4 \mathrm{e}-31, which, together with the fact that f(x_(2))=0f\left(x_{2}\right)=0 shows that in this example too x^(**)x^{*} is computed with accuracy higher than the machine epsilon.
Table 2 Numerical results when solving ln(x^(2)+x+2)-x+1=0\ln \left(x^{2}+x+2\right)-x+1=0
We make the following comments regarding the convergence order of the obtained sequences. Since they are monotonic in these two examples, the quotient convergence factors [9, ch. 9] can be determined by (9), taking into account the mean value formulas for divided differences, as
Therefore, since in both examples f^('')(x^(**))!=0f^{\prime \prime}\left(x^{*}\right) \neq 0, the qq-convergence order is exactly 6 . However, the above quantity requires the knowledge of the solution x^(**)x^{*}. In [4] and [5], the asymptotical constant Q_(6){x_(k)}Q_{6}\left\{x_{k}\right\} was approximated by some quantities computable at each step:
In Example 8, formula (12) (with x^(**)x^{*} considered as x_(2)x_{2} ) yields the value 6.3e-4, while formula (13) for k=1k=1 yields 7.1e-47.1 \mathrm{e}-4, i.e., two close quantities. These values are also close in Example 9, where we obtain 1.0e-6, respectively 3.5e-7.
Some other formulas to determine the convergence order were considered in [21]:
but since in the presented examples the solution was approximated in only three steps (the convergence order is high), we cannot use these formulas.
References
Amat, S., Busquier, S.: A two step Steffenssen's method under modified convergence conditions. J. Math. Anal. Appl. 324, 1084-1092 (2006)
Beltyukov, B.A.: An analogue of the Aitken-Steffensen method with controlled step. URSS Comput. Math. Math. Phys. 27(3), 103-112 (1987)
Chun, C.: A geometric construction of iterative formulas of order three. Appl. Math. Lett. 23, 512-516 (2010)
Cordero, A., Torregrosa, J.R.: Variants of Newton's method for functions of several variables. Appl. Math. Comput. 183, 199-2008 (2006)
Cordero, A., Torregrosa, J.R.: Variants of Newton's method using fifth order quadrature formulas. Appl. Math. Comput. 190, 686-698 (2007)
Cordero A., Torregrosa R.J.: A class of Steffenssen type method with optimal order of convergence. Appl. Math. Comput. 217, 7653-7659 (2011)
Hongmin, R., Qingbio, W., Welhong, B.: A class of two-step Steffensen type methods with fourth order convergence. Appl. Math. Comput. 209(2), 206-210 (2009)
Jain, P.: Steffensen type method for solving non-linear equations. Appl. Math. Comput. 194, 527-533 (2007)
Ortega, J.M., Rheinboldt, W.C.: Iterative Solution of Nonlinear Equations in Several Variables. Academic Press, New York (1970)
Ostrowski, M.A.: Solution of Equations in Euclidian and Banach Spaces. Academic Press, New York and London (1973)
Păvăloiu, I.: Approximation of the root of equations by Aitken-Steffensen-type monotonic sequences. Calcolo 32, 69-82 (1995)
Păvăloiu, I., Cătinaş, E.: On a Steffensen-Hermite method of order three. Appl. Math. Comput. 215(7), 2663-2672 (2009)
Păvăloiu, I., Cătinaş, E.: On a Steffensen type method. In: Ninth International Symposium on Symbolic and Numeric Algorithms for Scientific Computing, Proceedings, pp. 369-375 (2007)
Păvăloiu, I.: Optimal algorithms, concerning the solving of equations by interpolation. In: Popoviciu, E. (ed.) Research on Theory of Allure, Approximation, Convexity and Optimization, Editura Srima, Cluj-Napoca, pp. 222-248 (1999)
Sharma, R.J.: A composite thid order Newton-Steffensen method for solving nonlinear equations. Appl. Math. Comput. 169, 242-246 (2005)
Traub, Y.F.: Iterative Method for Solution of Equations. Prentice-Hall, Englewood Cliffs, NJ (1964)
Weerakoon, S., Fernando, T.G.I.: A variant of Newton's method with accelerated third-order convergence. Appl. Math. Lett. 13(8), 87-93 (2000)
I. Păvăloiu ⋅ E. Cătinaş ( ⊠\boxtimes )
"Tiberiu Popoviciu" Institute of Numerical Analysis, Romanian Academy, P.O. Box 68-1, Cluj-Napoca, Romania
e-mail: ecatinas@ictp.acad.ro
I. Păvăloiu
e-mail: pavaloiu@ictp.acad.ro