On the numerical Picard iterations with collocations for the Initial Value Problem
January 21, 2018. Accepted: June 17, 2019. Published online: October 10, 2019.
Some variants of the numerical Picard iterations method are presented to solve an IVP for an ordinary differential system. The term numerical emphasizes that a numerical solution is computed. The method consists in replacing the right hand side of the differential system by Lagrange interpolation polynomials followed by successive approximations. In the case when the number of interpolation point is fixed a convergence result is given. For stiff problems, starting from a stabilization principle, it is given a variant of the Picard iteration method.
Finally, some numerical experiments are reported.
MSC. 65L05, 65L60, 65L04.
Keywords. Picard iterations, initial value problem, collocation.
1 Introduction
This paper presents variants of the Picard iterations to solve an initial value problem (IVP) for ordinary differential equations. On subintervals the right hand side of the differential system is replaced by Lagrange interpolation polynomials and then successive approximations are used. The interpolation nodes are the images of a set of reference points. The number of these reference points can be fixed or variable, i.e. increasing in number [ 8 ] .
When the number of reference nodes is fixed the approximations of the solution of the IVP are computed by collocations. A convergence result is given. This case appears in [ 7 , p. 211 ] . In [ 3 ] the spectral deferred correction is defined adding a term to the iteration formula and the convergence of that method is proved.
If the number of reference points increases then the values of the unknown function are determined iteratively [ 8 ] .
The idea to replace the right hand side of a differential equation with an interpolation polynomial occurs in the multi-step methods, but instead of using the points of the main mesh a reference set of points is used. The usage of an iterative process to obtain some convergence is present in predictor-corrector methods.
We use the terminology numerical Picard iterations to emphasize that the method builds a numerical solution. For an IVP the usual Picard iterations are exemplified with Computer Algebra code in [ 12 ] .
For stiff problems, starting from a stabilization principle, [ 4 ] , [ 2 ] , we derived a variant of the Picard iteration method.
There is another approach to the numerical Picard iterations for an IVP, where the approximations are a linear form of Chebyshev polynomials [ 6 ] , [ 1 ] , [ 3 ] .
Sometimes to verify a numerical computation, it is a practical rule to use two different tools or methods. The presented methods offer an alternative to solve an IVP.
The paper is organized as follows. After introducing the numerical Picard iterations method in Section 2, two cases are presented in the next sections. In Section 3 the Picard iteration method is studied when the reference set contains a fixed number of points, while in Section 4 the Picard iteration method is considered with an increasing in number of points of the reference set. In Section 5 the case of a stiff problem is treated. In the last section some results of our computational experiments are presented.
2 Numerical Picard iterations
Let the IVP be given by
where the function
In
We assume that
and consequently
where
The IVP (2.1)-(2.2) may be reformulated as the integral equation
Within these hypotheses the problem (2.1)-(2.2) or (2.3) has a unique solution. This solution may be obtained with the Picard iterations
for
Let
If
will be replaced by a Lagrange interpolation polynomial
The interpolation nodes
From (2.5) we deduce
where
3 Picard iterations with a fixed reference set
In (2.6) the values
are unknown. To compute these vectors the collocation method will be used.
Choosing
The relations (3.8) form a nonlinear system with the unknowns
In order to simplify and provides a unitary approach to the computation of the integrals from (3.8) we fix the nodes
maps the interval
If
and
Denoting
the nonlinear system (3.8) becomes
In order to prove the existence of a solution of the nonlinear system we shall use a simplified notation
The operator
is defined by
The used norm in
If
Then
and
If
Thus, if
For
In the hypothesis of the above theorem, the nonlinear system (3.9) may be solved using the successive approximation method
for
will converge to the solution of the system (3.9).
The iterative relations (3.12) can be written in matrix form
where
This method to solve the nonlinear system (3.9) leads to an approximation to the solution of the IVP in the most right node which may differ from
We change the initial mesh such that
will be the most right node ( ) and the computation continue in the interval In this case we haveIn (2.5) we set
andIn this way
new integrals must be computed additionally.
With the new notations we have
The coefficients
Some particular cases
Equidistant nodes. If
thenThe following Mathematica code computes these coefficients:
The results obtained for
areBecause
şi the recurrence formula (3.12)-(3.13) becomesFor
the results areIn this case
and the recurrence formulas (3.12)-(3.13) becomeIn matrix form the above relations are
Transposing the above equality we get the form corresponding to (3.14).
To compute
we observe that for the trapezoidal rule (3.15), while for the Simpson integration formula (3.16) are used.Chebyshev points of second kind
Thenwith
The nodes are the roots of an orthogonal polynomial. Now we suppose that the polynomial
is orthogonal to the set of polynomials of degree at most with the weight on the interval In this case the Lagrange fundamental polynomials are orthogonal.If
then is the Laguerre polynomial. For and following results are obtainedAgain we observe that
is computed using the rectangle rule in the right hand side of (2.5).The Chebyshev polynomials
are orthogonal with the weight inThe nodes will be
The biggest node is
The Lagrange fundamental polynomials areand
The integral can be analytically computed but it involves rounding errors.
3.1 The convergence of the method
When
We suppose that:
The function
is continuous and then there exists a constant such thatThe function
have continuous partial derivatives of order for any There exists such that
In any interval
where
We denote by
and
We make the following notations
and additionally
We emphasize that
Several times the following theorem will be used
If
then
The above inequality implies: if
The following result of convergence occurs:
If the above assumptions take place then
that is, the convergence of the method.
For
and then we deduce
If
Subtracting (3.12) from (3.18)we obtain
It follows that
If
Evaluating
or
Corresponding to the two cases, from (3.17) we obtain the equalities
and respectively
Computing
respectively
It follows that
and
We remark that between the two estimates only the upper index of
From hereon it is sufficient to consider only the first case. Using (3.19) we obtain
Because
Consequently
Because
for
4 Picard iterations with a variable reference set
We shall keep some of the above introduced notations and we shall define those that differ.
Let
If
For
where
The vectors
It was taken into account that
for
We must compute
too.
The computation of the vectors
and the matrix
The following equality holds
For an imposed tolerance
A convergence result is given in [ 8 ] .
5 Stiff problems
From (2.3), if
with
Setting
we derive that
Following [ 4 ] , [ 2 ] , by the stabilization principle, the solution of the partial differential system
has the property, cf. [ 4 ] , [ 2 ] ,
We give a numerical solution to find an approximation of the solution of (5.19).
Let be
and integrating from
Without changing the notation for
where
We denote
Denoting
The iterations occurs until the stopping condition
6 Numerical experiments
Using computer programs based on these methods we solved the following IVPs:
( [ 9 , p. 234 ] )
with the solution
For
and the tolerance the maximum error and the number of calling the function are given in Table 6..Fixed equidistant
Variable reference set
reference set
Error
Error
1.82591e-08
75
8.94274e-08
99
Table 6. Results for Example (1). ( [ 9 , p. 244 ] )
where
and with the solutionThe results of our numerical experiments are listed in Table 6..
Fixed equidistant
Variable reference set
reference set
Error
Error
10
0.0247309
300
6.47998e-05
550
10
0.0246415
480
2.24345e-09
1050
10
0.888217
534
0.000142862
966
20
0.0496889
960
1.05491e-08
2100
10
14.4197
762
6.23799e-05
1530
40
0.0232977
1560
3.06542e-09
3640
Table 6. Results for Example (2). Now we compare the results obtained using equidistant nodes and Chebyshev points of second kind for the reference set. For the same example the obtained results are given in Table 6..
Fixed equidistant
Chebyshev fixed
reference set
Error
Error
10
6.93002e-05
400
2.69646e-05
400
10
1.91509e-05
650
8.13527e-06
650
10
0.00215349
600
0.000338729
551
20
3.85763e-05
1300
1.6391e-05
1300
10
0.0275954
900
0.0164587
820
40
1.00764e-05
2200
4.18516e-06
2200
Table 6. Results for Example (2). As expected, the results using Chebyshev points of second kind are better than that obtained using equidistant nodes, due to the better approximation property of Lagrange interpolation polynomial with Chebyshev points of second kind toward the equidistant points, [ 11 ] .
( [ 9 , p. 245 ] ) Keeping the differential system as in the previous example but changing the initial value conditions to
for and with the method based on variable reference set we obtained andIn this case the solution is
where
Based on the previous examples the method with variable number of reference points is more efficient than the method with fixed number reference points, but we cannot deduce theoretically such a conclusion.
Using the method for stiff problems presented above we solved:
with the solution
For
the results are given in Table 6.. We recall that is the length of the step for the variable of the stabilization principle.Fixed equidistant
Chebyshev fixed
reference set
Error
Error
300
0.00164977
8585
0.000402419
8435
500
0.000128781
10700
4.35037e-05
10555
Table 6. Results for Example (4). For
and the results are given in Table 6..Fixed equidistant
Chebyshev fixed
reference set
Error
Error
1.19382e-06
800
4.58431e-07
785
Table 6. Results for Example 5.
To make the results reproducible we provide some code at https://github.com/e-scheiber/scilab-ivpsolvers.git.
The author wishes to thank the referee for suggesting many improvements of this paper.
Bibliography
- 1
X. Bai, Modified Chebyshev-Picard Iteration Methods for Solution of Initial Value and Boundary Value Problems. PhD Dissertation, 2010, Texas A&M University.
- 2
- 3
F.M. Causley, C.D. Seal, On the Convergence of Spectral Deferred Correction Methods. arXiv:1706.06245v1 [math.NA], 2017.
- 4
- 5
- 6
- 7
E. Hairer, G. Wanner, S. Nørsett, Solving Ordinary Differential Equations. I Nonstiff Problems, Second Ed, Springer, Berlin, 1993.
- 8
E. Scheiber, A multistep method to solve the initial value problem. The 4th Romanian-German Seminar on Approximation Theory and its Applications. Braşov, 2000 (ed. H. Gonska, D. Kacso, L. Beutel) Gerhard Mercator Universitat, Duisburg, 124–132.
- 9
L.F. Shampine, M.K. Gordon, Computer solution of ordinary differential equation. The initial value problem, W.H. Freeman and Company, San Francisco, 1975.
- 10
J. Stoer, R. Bulirsch, Introduction to Numerical Analysis, Springer-Verlag, New York, 1993.
- 11
N.L. Trefethen, ApproximationTheory and Approximation Practice, SIAM, Philadelphia, 2012.
- 12
***, http://mathfaculty.fullerton.edu/mathews/n2003/PicardIterationMod.html, 2017.