New Accelerated Modulus-Based Iteration Method
for Solving Large and Sparse
Linear Complementarity Problem
Abstract.
For the large and sparse linear complementarity problem, we provide a family of new accelerated modulus-based iteration methods in this article. We provide some sufficient criteria for the convergence analysis when the system matrix is a -matrix or an -matrix. In addition, we provide some numerical examples of the different parameters to illustrate the efficacy of our proposed methods. These methods help us reduce the number of iterations and the time required by the CPU, which improves convergence performance.
Key words and phrases:
linear complementarity problem, -matrix, -matrix, matrix splitting, convergence.2005 Mathematics Subject Classification:
65F10, 90C33, 65F50.1. Introduction
The large and sparse matrices are matrices that have a large number of rows and columns but a small number of non-zero elements. In other words, they are matrices where the majority of the elements are zero. Sparse matrices are commonly used to represent complex systems or large datasets in fields such as computer science, mathematics, physics and engineering. The sparsity of the matrix means that it is not practical to store each element individually and specialized data structures and algorithms must be used to efficiently store and manipulate the matrix.
Let us assume that the matrix is large and sparse and that it is associated with the vector . The objective of the linear complementarity problem, referred to as LCP, is to determine the solution to the following system:
(1) |
Applications of the linear complementarity problem that have received significant study in the literature on mathematical programming include the free boundary problem, the Nash equilibrium point of the bimatrix game, operations research, control theory, mathematical economics, optimization theory, stochastic optimal control, and the American option pricing problem.
The methods available for solving the linear complementarity problems are into two groups namely the pivotal method [26], [18] and the iterative method [12], [4], [7] and [8]. The objective behind the iterative method is to produce a sequence of iterates that lead to a solution, but the pivotal method develops a series of pivot steps that lead to a basic feasible complementary vector through a series of pivot steps.
Reformulating the LCP into an equation whose solution must be the same as the LCP is one of the most well-known and attractive methods of constructing fast and inexpensive iteration methods. Consequently, certain useful LCP equivalent forms have arisen. Mangasarian [22] presented three methods: projected Jacobi over-relaxation, projected SOR and projected symmetric SOR. For additional details regarding developing iteration methods based on Mangasarianโs notion, see also [6], [35] and [10]. Bai has offered the following equivalent form in [34]:
(2) |
where and is a positive diagonal matrix and developed a class of modulus-based matrix splitting iteration methods. The Equation (2) covers the published works in [2], [28], [20], [13] and [5]. This kind of modulus-based matrix splitting iteration method has been considered efficient for solving the LCP. For other formulations of Equation (2), see [21], [16], [29], [31] and [17] for more details. Furthermore, this concept has been successfully applied to other complementarity problems, including the horizontal linear complementarity problem [11], the implicit complementarity problem [19], the nonlinear complementarity problem [9] and [33], [14] and the quasi-complementarity problem [27].
Bai [34] solved linear complementarity problems using modulus-based matrix splitting methods. However, the number of iterations in these methods is large enough to accomplish the optimal approximate solution to the numerical instances. In this paper, we introduce a class of new accelerated modulus-based iteration techniques for solving the large and sparse LCP. These methods are based on the work of Shilang [30] and Bai [34]. We demonstrate that the linear complementarity problem and the fixed point equation are equivalent and both have the same solution. In addition, we present several convergence conditions for the method that we proposed.
The article is structured as follows: In Sectionย 2, we provide necessary definitions, notations and well-known lemmas. All of these things will be used in the discussions in the subsequent sections of this work. A new accelerated modulus-based iteration method is presented in Sectionย 3 and it makes use of the new equivalent fixed point form of the LCP. In Sectionย 4, we define certain convergence domains for the proposed approach. Sectionย 5 gives some examples of the numerical comparison that is made between the methods that have been suggested and the modulus-based matrix splitting methods that were presented by Bai [34]. Sectionย 6 provides the conclusion.
2. Preliminaries
In this section, we introduce some basic notations, definitions and lemmas, most of which may be found in [32], [3], [25], that will be used throughout the article to examine the convergence analysis of the proposed methods.
The following is a list of related notations that are used for a given large and sparse matrix :
-
โข
Let and . We use to denotes , ;
-
โข
denotes the transpose of the given matrix or vector;
-
โข
We use to denotes ;
-
โข
, ;
-
โข
represents the inverse of the matrix ;
-
โข
is a real positive diagonal matrix of order ;
-
โข
is euclidean norm of a vector i.e. let then ;
-
โข
Let is the vector whose component is
; -
โข
Assume where and , are the strictly lower, upper triangular matrices of , respectively.
Let and be square matrices. The comparison matrix of is defined as if and if ; a -matrix if all of its non-diagonal elements are less than equal to zero; an -matrix if as well as -matrix; an -matrix, if is an -matrix and an -matrix if is an -matrix as well as ; a -matrix if all its principle minors are positive such that . The splitting is called an -splitting if is a nonsingular -matrix and ; an -splitting if is an -matrix; an -compatible splitting if .
Lemma 1 ([23]).
Let . , , if and only if .
Lemma 2 ([3]).
Let . If and are and -matrices, respectively, with then is an -matrix. If is an -matrix then .
Lemma 3 ([32]).
Let be an -matrix and be an -splitting, then ย .
Lemma 4 ([3]).
Suppose , if there exist and a scalar such that , then . Moreover, if , then .
3. Main results
Suppose vector and , where is the identity matrix of order and is the strictly lower triangular matrix of . In the following result, we convert the LCP into a fixed point formulation.
Theorem 5.
Suppose with the splitting and . Let , , where , and is a positive diagonal matrix and the matrix be a nonsingular. Then the equivalent formulation of the LCP in form of fixed point equation is
(3) |
Proof.
Let , the above equation can be rewritten as,
Hence, this is the equivalent form of the LCP as a fixed point equation.
In the following, based on Equation (3), we propose an iteration method which is referred to as a โnew accelerated modulus-based iteration methodโ to solve the LCP. Let the Euclidean norm of the error vector be denoted by the term โresidual,โ which is defined as follows:
Letโs assume that is an initial vector that is not negative. When the sequence converges or , the iteration process stops. To calculate , we apply an algorithm that is shown here.
Step 1. Given an initial vector , and set ;ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย
Step 2. Generate the sequence using the following scheme:
(4) |
and set , where is a approximate solution of LCP and is a approximate solution of Equation (4);
Step 3. Stop if ; otherwise, set and return to Step 2.
Furthermore, the proposed new accelerated modulus-based iteration method offers a generic framework for solving LCP. We created a new family of accelerated modulus based relaxation methods using matrix splitting. In specifically, the system matrix A is expressed as follows: as . Then
-
(a)
when , , and , Equation (4) gives the new accelerated modulus iteration method is
-
(b)
when , , and , Equation (4) gives the new accelerated modified modulus-based iteration method is
-
(c)
when , and , Equation (4) gives the new accelerated modulus-based Jacobi iteration method is
-
(d)
when , and , Equation (4) gives the new accelerated modulus-based Gauss-Seidel iteration (NAMGS) method is
-
(e)
when and , Equation (4) gives the new accelerated modulus-based successive over-relaxation iteration (NAMSOR) method is
-
(f)
when and , Equation (4) gives the new accelerated modulus-based accelerated over-relaxation iteration (NAMAOR) method is
The NAMAOR method clearly converts into the following methods:
-
(a)
New accelerated modulus-based successive over-relaxation (NAMSOR) method when takes the values .
-
(b)
New accelerated Gauss-Seidel (NAMGS) method when .
-
(c)
New accelerated Jacobi method when and .
4. Convergence analysis
In the following result, we prove the convergence conditions when the system matrix is a -matrix. When is a -matrix, Equation (1) has a unique solution for every [15].
Theorem 6.
Let be a -matrix and be the solution of Equation (3). Suppose . Then the sequence generated by Algorithmย 1 converges to the solution for any starting vector .
Proof.
We have , therefore
This implies that
Therefore the sequence for any starting vector is converges.
Since , when the sequence generated by Algorithmย 1 converges to the solution , then the sequence also converges.
When the system matrix is an -matrix, the following result discusses the convergence domain of for a new accelerated modulus based iteration method.
Theorem 7.
Let be an -matrix and be an -compatible splitting of the matrix , such that and either one of the following conditions holds:
(1) ;
(2) and , is an - matrix, .
Then the sequence generated by Algorithmย 1 converges to the solution for any starting vector .
Proof.
Case 1. ,
Since is an -matrix, then there exists a positive vector such that
Therefore
Now, we are able to establish that by making use of the 4.
Case 2. and is an -matrix. Then,
Since is an -matrix. Then there exists a positive vector such that
Therefore
We are able to establish that by making use of the 4. Due to this, the Theoremย 6 states that the iteration sequence generated by the Algorithmย 1 converges to for any starting vector
5. Numerical examples
In this section, several numerical examples are provided to demonstrate how effective our suggested methods are. IT stands for the number of iteration steps, while CPU represents the amount of time utilized on the CPU in seconds. Consider the LCP (), which always provides a unique solution. Let and , where is the unique solution of Equation (1). Let be initial vector. The proposed methods (NAMGS and NAMSOR) are compared to the modulus-based Gauss-Seidel (MGS) method and the successive over-relaxation (MSOR) method [34], which are effective in solving LCP. For all computations, Matlab version 2021a is used on an Acer desktop equipped with an Intel Core i7-8700 processor running at 3.2 GHz 3.19 GHz, and 16.00 GB of RAM. Tablesย 1, 2 andย 3 provide the numerical results of the new accelerated modulus-based iteration methods and the modulus-based matrix splitting method described in [34].
Example 8.
is the system matrix and it is formed by the expression , where is the positive real parameter, the identity matrix of order is denoted by the symbol and
,
,
where , .
n | ||||||
---|---|---|---|---|---|---|
MGS | IT | 42 | 43 | 44 | 45 | 45 |
CPU | 0.026006 | 0.071892 | 0.36788 | 0.9905 | 1.59 | |
Res | 8.391e-06 | 8.630e-06 | 8.768e-06 | 8.855e-06 | 9.9128e-06 | |
NAMGS | IT | 18 | 18 | 19 | 19 | 19 |
CPU | 0.013853 | 0.033635 | 0.12218 | 0.47709 | 0.70497 | |
Res | 5.098e-06 | 7.3423e-06 | 4.272e-06 | 6.069e-06 | 6.7921e-06 | |
MSOR | IT | 19 | 19 | 20 | 21 | 21 |
CPU | 0.013312 | 0.034213 | 0.12642 | 0.473 | 0.73996 | |
Res | 4.325e-06 | 8.943e-06 | 6.945e-06 | 5.351e-06 | 6.7001e-06 | |
NAMSOR | IT | 13 | 14 | 14 | 15 | 15 |
CPU | 0.010234 | 0.027824 | 0.090817 | 0.34313 | 0.52105 | |
Res | 5.763e-06 | 2.763e-06 | 5.265e-06 | 2.561e-06 | 3.1766e-06 |
Example 9.
is the system matrix and it is formed by the expression , where is the positive real parameter, the identity matrix of order is denoted by the symbol and
,
, .
n | ||||||
---|---|---|---|---|---|---|
MGS | IT | 27 | 28 | 28 | 29 | 29 |
CPU | 0.015293 | 0.04906 | 0.26455 | 0.63857 | 0.9857 | |
Res | 7.385e-06 | 6.193e-06 | 8.809e-06 | 7.332e-06 | 8.2027e-06 | |
NAMGS | IT | 13 | 13 | 14 | 14 | 15 |
CPU | 0.010722 | 0.026676 | 0.091557 | 0.32604 | 0.54924 | |
Res | 5.291e-06 | 9.578e-06 | 4.257e-06 | 8.154e-06 | 2.3597e-06 | |
MSOR | IT | 15 | 16 | 16 | 16 | 17 |
CPU | 0.012181 | 0.028711 | 0.10672 | 0.36204 | 0.58685 | |
Res | 6.344e-06 | 3.485e-06 | 5.645e-06 | 9.671e-06 | 3.7163e-06 | |
NAMSOR | IT | 9 | 10 | 10 | 10 | 10 |
CPU | 0.0072254 | 0.019398 | 0.066067 | 0.23302 | 0.34536 | |
Res | 5.874e-06 | 1.640e-06 | 3.335e-06 | 6.727e-06 | 8.4226e-06 |
Example 10.
is the system matrix and it is formed by the expression , where is the positive real parameter, the identity matrix of order is denoted by the symbol and
,
.
n | ||||||
---|---|---|---|---|---|---|
MGS | IT | 44 | 46 | 47 | 48 | 48 |
CPU | 0.021707 | 0.075858 | 0.38078 | 1.0475 | 1.6284 | |
Res | 9.7023e-06 | 7.152e-06 | 7.306e-06 | 7.414e-06 | 8.3004e-06 | |
NAMGS | IT | 21 | 22 | 22 | 23 | 23 |
CPU | 0.013821 | 0.038337 | 0.13761 | 0.50668 | 0.79966 | |
Res | 8.262e-06 | 5.740e-06 | 8.187e-06 | 5.625e-06 | 6.2949e-06 | |
MSOR | IT | 20 | 21 | 21 | 22 | 22 |
CPU | 0.014358 | 0.039287 | 0.12957 | 0.48699 | 0.7618 | |
Res | 5.683e-06 | 4.798e-06 | 9.742e-06 | 7.990e-06 | 9.9999e-06 | |
NAMSOR | IT | 17 | 17 | 18 | 19 | 19 |
CPU | 0.01243 | 0.029982 | 0.11366 | 0.42354 | 0.66273 | |
Res | 4.841e-06 | 8.427e-06 | 5.388e-06 | 3.473e-06 | 4.2525e-06 |
6. Conclusion
The article introduces a class of new accelerated modulus-based iteration methods for the solution of large and sparse LCP problems using matrix splitting. This iteration form maintains the sparsity and size of the matrix during the iteration process. Additionally, when system matrix is an -matrix, we demonstrate some convergence conditions. At last, the efficacy of the proposed methods is demonstrated through the presentation of various numerical instances.
Acknowledgements.
The first author would like to thank the University Grants Commission (UGC), Government of India, for funding the SRF fellowship program No. 1068 /(CSIR-UGC NET DEC. 2017).
References
- [1]
- [2] A Berman and R J Plemmons, Nonnegative Matrices in the Mathematical Science, (New York: Academic Press) (1979).
- [3] A Frommer and D B Szyl, -splittings and two-stage iteration methods, Numer. Math., 63 (1992) 345-356. https://doi.org/10.1007/BF01385865
- [4] A Hadjidimos and L.L. Zhang, Comparison of three classes of algorithms for the solution of the linear complementarity problem with an -matrix. Journal of Computational and Applied Mathematics, 336 (2018) 175-191. https://doi.org/10.1016/j.cam.2017.12.028
- [5] A Hadjidimos and M Tzoumas, Nonstationary extrapolated modulus algorithms for the solution of the linear complementarity problem, Linear Algebra Appl.431 (2009) 197-210.
- [6] B H Ahn, Solutions of nonsymmetric linear complementarity problems by iterative methods, J. Opt. Theory Appl. 33 (1981) 175-185. https://doi.org/10.1007/BF00935545
- [7] B Kumar, Deepmala, A Dutta, and AK Das. More on matrix splitting modulus-based iterative methods for solving linear complementarity problem. OPSEARCH, (2023) 1โ18. https://doi.org/10.1007/s12597-023-00634-3
- [8] B Kumar, Deepmala and A K Das, Projected fixed point iterative method for large and sparse horizontal linear complementarity problem. Indian Journal of Pure and Applied Mathematics (2023) 1-10. https://doi.org10.1007/s13226-023-00403-4
- [9] C F Ma and N Huang, Modified modulus-based matrix splitting algorithms for a class of weakly nondifferentiable nonlinear complementarity problems, Appl. Numer. Math., 108 (2016) 116-124. urlhttps://doi.org/10.1016/j.apnum.2016.05.004
- [10] D Yuan and Y Song, Modified AOR methods for linear complementarity problems, Applied Mathematics and Comput., 140(1) (2003) 53-67. https://doi.org/10.1016/S0096-3003(02)00194-7
- [11] F Mezzadri and E Galligani, Modulus-based matrix splitting methods for horizontal linear complementarity problems, Numer. Alg., 83 (2020) 201-219. https://doi.org/10.1007/s11075-019-00677-y
- [12] H S Najafi and S A Edalatpanah, Modification of iterative methods for solving linear complementarity problems. Engineering Computations, 30(7) (2013) 910-923. https://doi.org/10.1108/EC-10-2011-0131
- [13] J L Dong and M Q Jiang, A modified modulus method for symmetric positive definite linear complementarity problems, Numerical Linear Algebra with Appl., 16(2) (2009) 129-143. https://doi.org/https://doi.org/10.1002/nla.609
- [14] J T Hong and C L Li, Modulus-based matrix splitting iteration methods for a class of implicit complementarity problems, Numer. Linear Algebra Appl., 23 (2016) 629-641.
- [15] K G. Murty, On the number of solutions to the complementarity problem and spanning properties of complementary cones, Linear Algebra Appl., 5 (1972), 65โ108. https://doi.org/10.1016/0024-3795(72)90019-5
- [16] L L Zhang, Two-step modulus-based matrix splitting iteration method for linear complementarity problems, Numer. Alg., 57 (2011) 83-99. https://doi.org/10.1007/s11075-010-9416-7
- [17] L L Zhang and Z R Ren, Improved convergence theorems of Modulus-based matrix splitting iteration methods for linear complementarity problems, Applied Mathematics Lett., 26(6) (2013) 638-642. https://doi.org/10.1016/j.aml.2013.01.001
- [18] M J Alves and J. Judice, On the use of a tabu pivoting technique for solving the linear complementarity problem, AMO-Advanced Modeling and Optimization 13 (2011) 111-140.
- [19] N Huang and C F Ma, The modulus-based matrix splitting algorithms for a class of weakly nondifferentiable nonlinear complementarity problems, Numer. Linear Algebra Appl., 23 (2016) 558-569. https://doi.org/10.1002/nla.2039
- [20] N W Kappel and L T Watson, Iterative algorithms for the linear complementarity problems, Int. J. Comput. Math., 19 (1986) 273-297.
- [21] N Zheng and J F Yin, Accelerated modulus-based matrix splitting iteration methods for linear complementarity problems, Numer. Alg., 64 (2013) 245-262. https://doi.org/10.1007/s11075-012-9664-9
- [22] O L Mangasarian, Solution of symmetric linear complementarity problems by iterative methods, Journal of Optimization Theory and Appl., 22 (1977) 465-485. https://doi.org/10.1007/BF01268170
- [23] R Ali, I Khan, A Ali and A Mohamed, Two new generalized iteration methods for solving absolute value equations using -matrix, AIMS Math., 7(5) (2022) 8176-8187.
- [24] R Jana, A.K. Das and A. Dutta, On hidden Z-matrix and interior point algorithm.OPSEARCH, 56(09) (2019) https://doi.org/10.1007/s12597-019-00412-0
- [25] S K Neogy, A K Das and A Gupta, Generalized principal pivot transforms, complementarity theory and their applications in stochastic games, Optimization Lett.,6(2) (2012) 339-356.
- [26] R W Cottle, Complementary pivoting algorithm, Encyclopedia of Operations, Research and Management Science 92 (2012).
- [27] S L Wu and P Guo, Modulus-based matrix splitting algorithms for the quasi-complementarity problems, Appl. Numer. Math., 132 (2018) 127-137. https://doi.org/10.1016/j.apnum.2018.05.017
- [28] V W M G Bokhoven, A class of linear complementarity problems is solvable in polynomial time, University of Technology, The Netherlands, Unpublished Paper, Dept. of Electrical Engineering (1980).
- [29] W Li, A general modulus-based matrix splitting method for linear complementarity problems of H-matrices, Appl. Math. Lett., 26 (2013) 1159-1164. https://doi.org/10.1016/j.aml.2013.06.015
- [30] W Shilang and L Cuixia, A class of new modulus-based matrix splitting methods for linear complementarity problem, Optimization Lett., 16 (2021) 1427-1443. https://doi.org/10.1007/s11590-021-01781-6
- [31] W W Xu, Modified modulus-based matrix splitting iteration methods for linear complementarity problems, Numer. Linear Algebra Appl., 22 (2015) 748-760. https://doi.org/10.1002/nla.1985
- [32] X M Fang, General fixed point method for solving the linear complementarity problem, AIMS Mathematics, 6(11) (2021) 11904-11920. https://doi.org/10.3934/math.2021691 Previous ArticleNext Article
- [33] Z C Xia and C L Li, Modulus-based matrix splitting iteration methods for a class of nonlinear complementarity problem, Appl. Math. Comput., 271 (2015) 34-42. http://dx.doi.org/10.1016/j.amc.2015.08.108
- [34] Z Z Bai, Modulus-based matrix splitting iteration methods for linear complementarity problems, Numerical Linear Algebra with Appl., 17(6) (2010) 917-933. https://doi.org/10.1002/nla.680
- [35] Z Z Bai and D Evans, Matrix multisplitting relaxation methods for linear complementarity problems, International Journal of Computer Math., 63(3-4) (1997) 309-326. https://doi.org/10.1080/00207169708804569