A Note on the Fixed Point Method
and the Linear Complementarity Problem\(^\ast \)
December 12, 2022; accepted: February 24, 2023; published online: July 30, 2023.
In this paper, we propose an extended form of a fixed point method for processing the large and sparse linear complementarity problem (LCP). We obtain an equivalent form of LCP by using two positive diagonal matrices and prove the equivalence. For the proposed method, we provide some convergence conditions when the system matrix is a \(P\)-matrix or an \(H_+\)-matrix or a symmetric positive definite matrix.
MSC. 65F10, 65F50.
Keywords. Linear complementarity problem, \(P\)-matrix, \(H_{+}\)-matrix, symmetric positive definite matrix, matrix splitting, convergence.
\(^\ast \)The first author is thankful to the University Grants Commission (UGC), Government of India under the SRF fellowship Program No. 1068/(CSIR-UGC NET DEC.2017).
\(^{\ast \ast }\)Mathematics Discipline, PDPM-Indian Institute of Information Technology, Design and Manufacturing, Jabalpur, M.P., India, e-mail: bharatnishad.kanpu@gmail.com, dmrai23@gmail.com.
\(^\S \)Indian Statistical Institute, 203 B.T. Road, Kolkata-700108, India, e-mail: akdas@isical.ac.in
1 Introduction
In the literature on mathematical programming, the linear complementarity problem has received considerable attention. It also appears in a number of applications in operations research applications, control theory, mathematical economics, optimization theory, stochastic optimal control, the American option pricing problem, economics, elasticity theory, the free boundary problem, and the Nash equilibrium point of the bimatrix game. For details, see [ 18 ] , [ 19 ] . For recent works on this problem, see [ 14 ] , [ 15 ] and references therein.
Consider \(A_1\in \mathbb {R}^{n\times n}\) and a vector \(\, q\, \in \, \mathbb {R}^{n}.\) The linear complementarity problem denoted as LCP\((q, A_{1})\) is to find the solution \(z\; \in \mathbb {R}^{n}\; \) to the following system
There are various methods of solving the LCP using an iterative process, namely the projected methods [ 4 ] , [ 9 ] , [ 12 ] , [ 16 ] , [ 20 ] , [ 21 ] , the modulus algorithm [ 2 ] , [ 3 ] , [ 5 ] , [ 10 ] and the modulus based matrix splitting iterative methods [ 8 ] , [ 11 ] , [ 22 ] .
A general fixed point method (GFP) is proposed by Fang [ 6 ] assuming the case where \(\phi = \omega A_{1D}^{-1}\) with \(\omega \) \(\textgreater \) \( 0\) and \(A_{1D}\) is a diagonal matrix of \(A_{1}\). The GFP approach takes less iterations than the modulus-based successive over-relaxation (MSOR) iteration method [ 2 ] . In this paper we present an extended form of the fixed point method [ 6 ] that incorporates projected type iteration techniques by including two positive diagonal parameter matrices \(\phi _1\) and \(\phi _2\). We also show that the fixed point equation and the linear complementarity problem are equivalent and discuss the convergence conditions as well as provide some convergence domains for the proposed method.
The rest of this paper is organized as follows: In section 2, we present some notation, definitions and lemmas in order to establish our key findings. Section 3 discusses an extended form of a fixed point method for solving LCP\((q, A_1)\) with convergence analysis. In the last section, we give the conclusion.
2 Preliminaries
Some notations, introductory definitions and required lemmas are introduced. For details, see [ 2 ] , [ 6 ] .
Let \( A_{1}= (a_{ij}) \in \mathbb {R}^{n\times n}\) and \(B_{1}=(b_{ij}) \in \mathbb {R}^{n\times n}\). We use \(A_{1} \geq \) \((\textgreater )\) \( B_{1}\) to denote \(a_{ij}\geq (\textgreater )\) \( b_{ij}\) for all \( i, j \). The comparison matrix \(\langle A_{1} \rangle = (\langle a_{ij} \rangle )\) of \(A_{1}\) is defined by \(\langle a_{ij} \rangle =|a_{ij}|\) with \(i=j\) and \(\langle a_{ij} \rangle =-|a_{ij}|\) with \(i\neq j\) for \(i,j=1,2,\ldots ,n\). The matrix \(A_{1}\) is called a \(Z\)-matrix if all of its non-diagonal elements are less than or equal to zero; an \(Z\)-matrix is called an \(M\)-matrix if \(A_{1}^{-1}\geq 0\); an \(H\)-matrix if \(\langle A_{1} \rangle \) is an \(M\)-matrix. The splitting \(A_{1}=M_{1}-N_{1}\) is called an \(M\)-splitting if det\((M_{1})\neq 0\) and \(N_{1} \geq 0\), an \(H\)-splitting if \(\langle M_{1} \rangle -|N_{1}| \) is an \(M\)-matrix [ 7 ] . An \(H\)-matrix is called an \(H_{+}\)-matrix [ 1 ] if \( {a}_{ii} ~ \textgreater ~ 0 ~ \) for\( ~ i = 1,2,\ldots ,n\). Let \(A_{1}\in \mathbb {R}^{n\times n}\), then \(A_{1}\) is said to be a \(P\)-matrix if all its principle minors are positive that is det\(({A_1}_{\alpha \alpha }) ~ \textgreater ~ 0\) for all \(\alpha \subseteq \{ 1,2,\ldots , n\} \). Suppose \( A_{1}=(a_{ij})\in \mathbb {R}^{n\times n}\) be a square matrix, then \( | A_{1} |=(c_{ij})\) is defined by \( c_{ij} = | {a}_{ij} | \) \(\forall ~ i,j\) and \(A_{1}^{T}\) denotes the transpose of \(A_{1}.\)
The LCP(\(q, A_1\)) has a unique solution for any \(q \in \mathbb {R}^n\) if \(A_1 \in \mathbb {R}^{n \times n}\) is a \(P\)-matrix.
Let \(A_{1}\in \mathbb {R}^{n\times n}\) and \(A_{1}=M_{1}-N_{1}\) be an \(M\)-splitting with \(M_{1}\) an \(M\)-matrix and \(N_{1}\geq 0\). Then \(\rho (M_{1}^{-1}N_{1})\) \(\textless \) \(1\).
3 Main results
For a given vector \(\xi \in \mathbb {R}^{n}\), we indicate the vectors \(\xi _{+}\)=max\(\{ 0,\xi \} \), \(\xi _{-}\)=
max\(\{ 0,-\xi \} \). Since \(\xi _{+}\geq 0\), \(\xi _{-}\geq 0\), \(\xi =\xi _{+}-\xi _{-}\), \(\xi ^T_{+}\xi _{-}=0.\) Let \(z=\phi _{1}\xi _{+}\) and \(w=\phi _{2}\xi _{-}\), where \(\phi _{1}\) and \(\phi _{2}\) are positive diagonal matrices of order \(n\). Now we convert the LCP into a fixed point formulation that is
where \(I_{1}\) is an identity matrix of order \(n\).
In the following result, we provide an equivalent formulation of the LCP\((q, A_{1})\) for solving LCP\((q, A_{1})\).
Suppose \(A_{1} \in \mathbb {R}^{n \times n}\) and \(q\in \mathbb {R}^n\). Then \(\xi ^{*}\) is a solution of 2 if and only if \(z^{*}=\phi _{1}\xi ^{*}_{+}\) is a solution of LCP\((q, A_{1})\).
Since \(\phi _{2}\xi ^{*}_{-} \geq 0\),
Moreover,
and \(\phi _{1}\xi ^{*}_{+}\geq 0\). Therefore \(z^{*}=\phi _{1}\xi ^{*}_{+}\) is a solution of LCP\((q,A_{1})\).
Let \(z^{*}=\phi _{1}\xi ^{*}_{+}\) and \(w^{*}=\phi _{2}\xi ^{*}_{-}\), and \(\xi ^{*}=\xi ^{*}_{+}-\xi ^{*}_{-}\). Now from LCP\((q,A_{1})\)
Thus, \(\xi ^{*}\) is a solution of 2.
Now we show that the solution of \(\eqref{eq2}\) is unique when the matrix \(A_1\) is a \(P\)-matrix.
For any positive diagonal matrices \(\phi _1\) and \(\phi _2\), 2 has a unique solution if \(A_{1} \in \mathbb {R}^{n \times n}\) is a \(P\)-matrix.
and
As \(y^{*}_{+} =u^{*}_{+}\),
Hence
Based on 2, we obtain an extended form of the fixed point method which is referred to as method 1.
Let \(A_{1}\in \mathbb {R}^{n \times n}\) and \(q \in \mathbb {R}^n\). Suppose \(\xi ^{(0)}\in \mathbb {R}^{n}\) an initial vector and the sequence \(\{ z^{(k)}\} ^{+\infty }_{k=1} \subset \mathbb {R}^{n}\). Let Residue be an Euclidean norm of the error vector and define the Residue as
where \( z^{(k)}\) is the \(k^{th}\) approximate solution of the LCP\((q,A_{1})\). The iteration process stop if \((z^{(k)})\) \(\textless \) \( 10^{-5} \) or the number of iteration reached 900. For computing \(\xi ^{(k+1)}\in \mathbb {R}^{n}\) is as follows:
Given an initial vector \(\xi ^{(0)} \in \mathbb {R}^{n}\), error \(\epsilon \) \(\textgreater \) \( 0 \) and set \( k=0 \).
Using the following scheme, create the sequence \(\xi ^{(k)}\):
\begin{eqnarray} \label{eq3} & \xi ^{(k+1)}=(I_{1}-\phi ^{-1}_{2}A_{1}\phi _{1})\xi ^{(k)}_{+}-\phi ^{-1}_{2}q \end{eqnarray}and set \(z^{(k+1)}=\phi _{1}\xi ^{(k+1)}_{+}\).
If \( (z^{(k)})\) \( \textless \) \(\epsilon \) then stop; otherwise, set \(k=k+1\) and return to step 2.
In the following result, we discuss the convergence condition when the system matrix \(A_{1}\) is a \(P\)-matrix.
Let \(A_{1} \in \mathbb {R}^{n \times n}\) be a \(P\)-matrix. Let \( \rho (|I_{1}-\phi ^{-1}_{2}A_{1}\phi _{1}|)\) \(\textless \) \(1 \) and \(\xi ^{*}\) be the solution of 2. Then the sequence \(\{ z^{(k)}\} ^{+\infty }_{k=1}\) generated by \(\cref{mthd1} \) converges to \(z^{*}\) for any initial vector \(\xi ^{(0)}\in \mathbb {R}^{n}\).
From 3, it results
It follows that
Since \(\rho (|I_{1}-\phi ^{-1}_{2}A_{1}\phi _{1}|)\) \(\textless \) \(1\). Hence, for any initial vector \(\xi ^{(0)}\in \mathbb {R}^{n}\) the sequence \(\{ z^{(k)}\} ^{+\infty }_{k=1}\) converges to the \(z^{*}\).
In the following result, we provide the convergence conditions for \(\cref{mthd1}\) when the system matrix is an \(H_{+}\)-matrix.
Assume \(A_{1} \in \mathbb {R}^{n \times n}\) is an \(H_{+}\)-matrix, \(A_{1D}=diag(A_{1})\) and \(B=A_{1D}-A_{1} \in \mathbb {R}^{n \times n}\). Let \(\phi _{1}=\alpha _{1}D_{1}\), \(\phi _{2}=\omega ^{-1}A_{1D}\) and
where \(\alpha _{1}\), \(\omega \) are positive constants and \(D_{1}\) is a positive diagonal matrix. Let \(\omega \alpha _{1}=\beta \) and \(\xi ^{*}\) be the solution of 2. Then the sequence \(\{ z^{(k)}\} ^{+\infty }_{k=1}\) generated by \(\cref{mthd1} \) converges to \(z^{*}\) for any initial vector \(\xi ^{(0)}\in \mathbb {R}^{n}\) if
It follows that
Now we write
From 8 we can seen that \(\rho (|I_{1}-\phi ^{-1}_{2}A_{1}\phi _{1}|)\) \(\textless \) \(1\) for \(\beta \rho (D_{1})\in (0, 1]\) and for \(\beta \rho (D_1)\) \(\textgreater \) \(1\), \(\rho (|I_{1}-\phi ^{-1}_{2}A_{1}\phi _{1}|)\) \(\textless \) \(1\) if and only if
such that \( \beta {\lt} \tfrac {2}{\big(1+\rho (A_{1D}^{-1}|B|)\big)\rho (D_1)}\). Therefore, if
for any initial vector \(\xi ^{(0)}\in \mathbb {R}^{n}\), the sequence \(\{ z^{(k)}\} ^{+\infty }_{k=1}\) converges to \(z^{*}\).
In the following result, we provide the convergence conditions for \(\cref{mthd1}\) when the system matrix is a symmetric positive definite (SPD) matrix.
Let \(A_{1} \in \mathbb {R}^{n \times n}\) be the SPD matrix. Let \(\phi _{2}=\omega ^{-1}I_{1}\) and \(\phi _{1}=\alpha _{1}D_{1}\), where \(D_{1}\) is a scalar matrix and denote the minimum and the maximum eigenvalues of \(A_{1}D_{1}\) by \(\nu _{min}\) and \(\nu _{max}\) respectively. Let \(\xi ^{*}\) be the solution of 2. Then the sequence \(\{ z^{(k)}\} ^{+\infty }_{k=1}\) generated by \(\cref{mthd1}\) converges to \(z^{*}\) for any initial vector \(\xi ^{(0)}\in \mathbb {R}^{n}\) if \( 0 \) \(\textless \) \(\beta \) \( \textless \) \( \frac{2}{\nu _{max}}\).
This implies that
Since \(\| (\xi _{+}^{(k)}-\xi ^{*}_{+})\| _{2} \leq \| (\xi ^{(k)}-\xi ^{*})\| _{2}\),
If \(\| I_{1}-\phi ^{-1}_{2}A_{1}\phi _{1}\| _{2} \) \(\textless \) \( 1\), then \(\cref{mthd1}\) is convergent. Therefore
We have
It follows that
Thus \(\| I_{1}-\beta A_{1}D_{1}\| _{2}\textless 1\) if and only if
and
From \((a)\) and \((b)\) we obtain the convergence condition of \(\cref{mthd1}\) that is \( 0 \) \(\textless \) \( \beta \) \(\leq \) \( \tfrac {2}{\nu _{min}+\nu _{max}}\) and \( \tfrac {2}{\nu _{min}+\nu _{max}} \) \( \leq \) \( \beta \) \( \textless \) \( \tfrac {2}{\nu _{max}}\), from these two inequalities we obtain
4 Conclusion
We introduced an extended form of a fixed point method for solving the linear complementarity problem LCP\((q, A _1) \) with parameter matrices \(\phi _1\) and \(\phi _2\). Also, we have shown how the iterative form relates to the parameter matrices \(\phi _1\) and \(\phi _2\). We have presented some convergence conditions and some sufficient convergence domains for the proposed method.
The authors are grateful to the editor associated with this paper for their excellent suggestions. Also, the authors thank the anonymous referees who spent their precious time for reviewing this paper. The authors would like to acknowledge their contribution, due to which there is a significant improvement in the paper.
Bibliography
- 1
Z.Z. Bai, On the convergence of the multisplitting methods for the linear complementarity problem, SIAM J. Matrix Anal. Appl., 21 (1999), pp. 67–78. https://doi.org/10.1137/S0895479897324032
- 2
Z.Z. Bai, Modulus-based matrix splitting iteration methods for linear complementarity problems, Numer. Linear Algebra Appl., 17 (2010) no. 6, pp. 917–933. https://doi.org/10.1002/nla.680
- 3
Z.Z. Bai, D. Evans, Matrix multisplitting methods with applications to linear complementarity problems: parallel asynchronous methods, Int. J. Comput. Math., 79 (2002), pp. 205–232. https://doi.org/10.1080/00207160211927
- 4
M. Dehghan, M. Hajarian, Convergence of SSOR methods for linear complementarity problems, Oper. Res. Lett., 37 (2009) no. 3, pp. 219–223. https://doi.org/10.1016/j.orl.2009.01.013
- 5
J.L. Dong, M.Q. Jiang, A modified modulus method for symmetric positive-definite linear complementarity problems, Numer. Linear Algebra Appl., 16 (2009) no. 2, pp. 129–143. https://doi.org/10.1002/nla.609
- 6
X.M. Fang, General fixed point method for solving the linear complementarity problem, AIMS Math., 6 (2021) no. 11, pp. 11904–11920. https://doi: 10.3934/math.2021691
- 7
A. Frommer, G. Mayer, Convergence of relaxed parallel multisplitting methods, Linear Algebra Appl., 119 (1989), pp. 141–152. https://doi.org/10.1016/0024-3795(89)90074-8
- 8
A. Hadjidimos, M. Lapidakis, M. Tzoumas, On iterative solution for linear complementarity problem with an \(H_+\)-matrix, SIAM J. Matrix Anal. Appl., 33 (2012) no. 1, pp. 97–110. https://doi.org/10.1137/100811222
- 9
A. Hadjidimos, L.L. Zhang, Comparison of three classes of algorithms for the solution of the linear complementarity problem with an \(H_{+}\)-matrix, J. Comput. Appl. Math., 336 (2018), pp. 175–191. https://doi.org/10.1016/j.cam.2017.12.028
- 10
N.W. Kappel, L.T. Watson, Iterative algorithms for the linear complementarity problem, Int. J. Comput. Math., 19 (1986) nos. 3-4, pp. 273–297. https://doi.org/10.1080/00207168608803522
- 11
S. Liu, H. Zheng, W. Li, A general accelerated modulus-based matrix splitting iteration method for solving linear complementarity problems, Calcolo, 53 (2016) no. 2, pp. 189–199. https://doi.org/10.1007/s10092-015-0143-2
- 12
O. Mangasarian, Solution of symmetric linear complementarity problems by iterative methods, J. Optim. Theory Appl., 22 (1977), pp. 465–485. https://doi.org/10.1007/BF01268170.
- 13
K.G. Murthy, On the number of solutions to the complementarity problem and spanning properties of complementarity cones, Linear Algebra Appl., 5 (1972), pp. 65–108. https://doi.org/10.1016/0024-3795(72)90019-5
- 14
S.K. Neogy, R. Bapat, A.K. Das, T. Parthasarathy, Mathematical Programming and Game Theory for Decision Making, World Scientific, 2008. https://doi.org/10.1142/6819
- 15
S.K. Neogy, A.K. Das, R. Bapat, Modeling, Computation and Optimization, World Scientific, 2021. https://doi.org/10.1142/7303
- 16
H.S. Najafi, S.A. Edalatpanah, Modification of iterative methods for solving linear complementarity problems, Eng. Comput., 30 (2013) no. 7, pp. 910–923. https://doi.org/10.1108/EC-10-2011-0131
- 17
S.K. Neogy, A.K. Das, A. Gupta, Generalized principal pivot transforms, complementarity theory and their applications in stochastic games, Optim. Lett., 6 (2012) no. 2, pp. 339–356. https://doi.org/10.1007/s11590-010-0261-3
- 18
S.K. Neogy, S. Sinha, A.K. Das, A. Gupta, Optimization models for a class of structured stochastic games, in Mathematics in Science and Technology: Mathematical Methods, Models and Algorithms in Science and Technology (2011), pp. 448–470. https://doi.org/10.1142/9789814338820_0016
- 19
S.K. Neogy, A.K. Das, S. Sinha, A. Gupta, On a mixture class of stochastic game with ordered field property, in Mathematical Programming and Game Theory for Decision Making, World Scientific (2008), pp. 451–477. https://doi.org/10.1142/9789812813220_0025
- 20
X.J. Shi, L. Yang, Z.H. Huang, A fixed-point method for linear complementarity problem arising from American option pricing, Acta Math. Appl. Sin. Engl. Ser., 32 (2016), pp. 921–932. https://doi.org/10.1007/s10255-016-0613-6
- 21
M.H. Xu, G.F. Luan, A rapid algorithm for a class of linear complementarity problems, Appl. Math. Comput., 188 (2007) no. 2, pp. 1647–1655. https://doi.org/10.1016/j.amc.2006.11.184
- 22
H. Zheng, W. Li, S. Vong, A relaxation modulus-based matrix splitting iteration method for solving linear complementarity problems, Numer. Algor., 74 (2017) no. 1, pp. 137–152. https://doi.org/10.1007/s11075-016-0142-7