Additive Operator Splitting Scheme
for a General Mean Curvature Flow
and Application in Edges Enhancement
Abstract.
Many models that use non-linear partial differential equations (PDEs) have been extensively applied for different tasks in image processing. Among these PDE-based approaches, the mean curvature flow filtering has impressive results, for which feature directions in the image are important.
In this paper, we explore a general model of mean curvature flow, as proposed in [ G.I. Barenblatt, Self-similar intermediate asymptotics for nonlinear degenerate parabolic free-boundary problems that occur in image processing, Proceedings of the National Academy of Sciences of the United States of America (2001)], [ G.I. Barenblatt and J.L. Vazquez, Nonlinear diffusion and image contour enhancement, Interfaces and Free Boundaries (2003)]. The model can be re-arranged to a reaction-diffusion form, facilitating the creation of an unconditionally stable semi-implicit scheme for image filtering. The method employs the Additive Operator Split (AOS) technique. Experiments demonstrated that the modified general model of mean curvature flow is highly effective for reducing noise and has a superior job of preserving edges.
Key words and phrases:
Nonlinear diffusion equations, mean curvature flow, additive operator splitting, unconditionally stable schemes, edge enhancement.2005 Mathematics Subject Classification:
.This research work is supported by the The General Direction of Scientific Research and Technological Development (DGRSDT)- Algeria.
1. Introduction
Partial differential equation (PDE) based techniques have been widely applied for various image processing tasks over the past few decades [30, 4, 32, 7, 14]. Designing numerical schemes that take into consideration accuracy, stability, and computational cost is fundamental for the effective implementation of these schemes.
Local geometric properties of images are usually dominated by two main directions: the direction perpendicular to the edge, called the flow-line, and parallel to the level or isophote, which is aligned with the edge. By selecting the appropriate degree of diffusion in these two directions, several approaches can be achieved [3, 26, 18, 9, 10].
Mean curvature flow is a prominent example where diffusion only occurs along edges. The theoretical properties of this were first studied by Gage, Hamilton and Huisken in the 1980s [16, 17, 15]. It is known that a plane curve moving at a normal speed equal to its curvature will shrink to a point, its shape becoming smoother and circular. In higher dimensions, the phenomena are more complex, with no classification is available yet. In the context of image processing, Osher and Sethian [22, 27] provided a more rigorous view, realization that the iso-intensity contours of an image can be moved under their curvature was achieved. This led to numerous papers where the images were viewed as a set of level contours, then moved under their curvature. Image smoothing by level-set curvature motion [19, 20] preserves edge information by thwarting diffusion in the edge direction. This work showed that, in addition to this basic approach, a natural stopping criterion can also be chosen to prevent over-smoothing a given image.
A general mathematical framework for feature-preserving image smoothing, applicable to gray-level, vector-value (color) images, volumetric images, and movies was achieved by Sochen, Kimmel, and Malladi in [28, 29]. The main idea is to view the image as a two-dimensional manifold embedded in a hybrid spatial-feature space. The authors in [29] showed that many classical geometric flows emerge as special cases in this view, along with a new flow known as the Beltrami flow, which moves a Gray-level image under a scaled mean curvature. By following a different approach, Yezzi in [33] arrived at a similar equation.
As a result of the certain degeneracy of the asymptotic forms of equations mentioned in [20, 29], Barenblatt [5] noted the possibility of constructing a more general class of equations that generalized mean curvature motion and Beltrami flow. An asymptotic treatment in the one-dimensional case of this class of equations has been investigated theoretically in [5, 6]. The authors report that the general mean curvature flow equation forms a sharp step in the vicinity of edges.
The task of smoothing noisy images and enhancing their edges generally involves solving partial differential equations using numerical integration. This process is often the most time-intensive aspect of nonlinear image processing algorithms. Recently, a lot of research efforts have focused on developing numerical methods and techniques for solving equations dependent on curvature in image processing (see, e.g., [24, 25, 21, 34]).
Our objective is to numerically solve the modified general model of mean curvature flow and to confirm the one-dimension theoretical results obtained in [5]. This is achieved through the development of finite difference schemes for the two-dimensional model. We aim to investigate two critical aspects: The phenomenon of edge enhancement within the image, and the model’s efficacy in noise reduction. Using explicit finite difference schemes can be very time-consuming due to the scaling and small time step requirements in order to achieve stability. Therefore, developing fast and unconditionally stable schemes is preferable. The additive operator splitting (AOS) method, introduced by Weickert et al. [31] for the nonlinear diffusion flow, as an unconditionally stable scheme, is effective and efficient. Applying the (AOS) method in the modified general model of mean curvature flow requires writing the model to allow this method’s application, which we will detail in this paper.
The paper is structured as follows: In Section 2, we present the mathematical model associated to a general mean curvature flow for edge enhancement. Section 3 is devoted to the presentation of the numerical processing, particularly splitting the model and spatial discretization are presented, then the proposed numerical scheme for solving the discretized problem are exposed. Section 4 presents the numerical experiments for image processing. Finally, the paper concludes by a short conclusion.
2. A general mean curvature flow
The level set method [22, 27] elegantly handles mean curvature flow. Essentially, it views the curve as the level
set
(1) |
where
(2) | |||||
which called the mean curvature flow equation.
Sochen et al. [29] used a differential-geometric
approach with various assumptions regarding the image intensity flux, leading them to derive the following equation for image intensity
(3) |
which called the Beltrami flow (selective mean curvature flow). Here,
As a result of a certain degeneracy of the asymptotic forms of equations
(4) |
where
(5) |
Here, the variable
Equation
The difference of equation
The asymptotic treatment of this model, for
Solving nonlinear PDEs using explicit methods can be very time consuming due to the scaling and small time step requirement. In this paper our goal is to build a fast and reliable method to solve the general mean curvature flow equation (GMCF)
where
3. Additive Operator Splitting scheme for the general mean curvature flow
To numerically solve equation (5), we utilize the Additive Operator Splitting (AOS) technique, originally introduced by Weickert et al. [31], as an efficient, reliable, and unconditionally stable schemes for nonlinear diffusion in image processing. We adapt the AOS technique to the general mean curvature flow (GMCF), which, although distinct from nonlinear diffusion, can be treated similarly.
Splitting the GMCF
Consider the general mean curvature flow compared with the nonlinear diffusion of a gray-level image. Let
(6) |
where
To simplify Equation (6), we have:
We set
(7) |
In this form, the equation is not a pure diffusion equation. It has both an “parabolic” edge-preserving and an “hyperbolic” edge-sharpening terms. In addition, the reaction-diffusion form of equation
In more concise terms, the equation can be rearranged as:
(8) |
where
(9) |
Applying the backward difference formula to
(10) |
Here, the superscript
(11) |
where
Note that equation
(12) |
Of course, we do not intend to invert the matrix to solve the linear set. This is merely a symbolic form used for further derivation.
Equation
(13) |
The problem is that the right hand sides of equations
This can be simplified into:
Putting
Thus we have:
Based on this, to use the additive operator splitting scheme given by equation
which is the same as:
Now, the whole idea of this scheme is to bring the equation to a simpler form, allowing us to use efficient block-wise solvers, such as Tri-diagonal matrix algorithm.
Introducing the notations
(14) |
We finally obtain the equation sets for
(15) |
The differential operators
Discretisation
To discretize the first derivative, we approximate it using a centered finite difference scheme as follows:
For the classical finite difference approximation of the second derivative, we utilize the classical three points scheme:
Note that the omitted error terms are of order
(16) |
To avoid establishing the values of the edge indicator function
(17) |
Substituting these averages into the equation (16), we get
(18) | ||||
Denote:
At each time step, we solve an algebraic system where the matrix
A similar equation holds for
(20) |
where
For the first and last nodes, the Neumann boundary conditions hold:
4. Numerical experiment
In this section, we examine the impact of the model (5) presented in this paper on a diverse range of gray scale images. Additionally, we compare the results obtained with those from the Perona-Malik (for
The images in Fig. 1 demonstrate the effects of diffusion at different values of the contrast parameter
Although a larger number of iterations were required to achieve an equivalent level of smoothing for larger values of
From the images in Fig. 3, one can easily see that the larger exponent
As a conclusion from the experiments presented, it can be said that larger values of
The second simulation concerned the efficacy of the model studied in reducing noise. Experiments were conducted on distorted images with a Gaussian and salt-and-pepper noise. Fig. 4 and Fig. 5 show how noise reduction and edge preservation can be combined using this model. We can observe that it is possible to obtain sharp edges even after a large number of iterations for the large values of





5. Conclusion
In this study, we re-arrange the governing equation for the modified general model of mean curvature flow proposed in [5, 6] into a reaction-diffusion form, where the reaction and diffusion terms are explicitly represented. This reaction-diffusion form enables the development of an unconditionally stable semi-implicit scheme for image filtering. The method is based on the Additive Operator Split (AOS), originally applied by Weickert [31] for the nonlinear diffusion flow. The values of the edge indicator function are used from the previous step in scale, while the pixel values of the next step approximate the flow. This approach leads to a semi-implicit linearized difference scheme. The computational time required for image filtering can be reduced by up to ten times or even more compared to the explicit scheme, depending on the scale step value, with no loss of accuracy. Whereas, using explicit finite difference schemes can be very time-consuming due to the scaling and small time-step requirements in order to achieve stability.
Experiments have demonstrated that the modified general model of mean curvature flow is highly effective in reducing noise and excels in edges preservation for large values of exponent
References
- [1]
- [2] H. Achour, R. Chouder. N. Benhamidouche, Self-similar solutions for a new free-boundary problem and image contour enhancement, Dynamics of Continuous, Discrete and Impulsive Systems. Series B: Applications & Algorithms, 31 (2024), pp. 321–337. https://online.watsci.org/abstract_pdf//2024v31/v31n5b-pdf/3.pdf
- [3] L. Alvarez, P.L. Lions, J.M. Morel, Image selective smoothing and edge detection by nonlinear diffusion, II, SIAM J. Numer. Anal., 29 (1992), pp. 845–866. https://doi.org/10.1137/0729052
- [4] G. Aubert, and P. Kornprobst, Mathematical Problems in Image Processing - Partial Differential Equations and the Calculus of Variations, Springer, Berlin, 2002.
- [5] G.I. Barenblatt, Self-similar intermediate asymptotics for nonlinear degenerate parabolic free-boundary problems that occur in image processing, Proceedings of the National Academy of Sciences of the United States of America, 98 (2001) no. 23, pp. 12878-12881. https://doi.org/10.1073/pnas.241501698
- [6] G.I. Barenblatt and J.L. Vazquez, Nonlinear diffusion and image contour enhancement, Interfaces and Free Boundaries, 6 (2003) no. 1, pp. 31-54. https://doi.org/10.4171/IFB/90
- [7] S. Benalia and M. Hachama, A nonlocal method for image shadow removal, Computers & Mathematics with Applications, 107 (2022), pp. 95-103. https://doi.org/10.1016/j.camwa.2021.12.023
- [8] N. Benhamidouche, Exact solutions to some nonlinear PDEs, travelling profiles method, Electronic Journal of Qualitative Theory of Differential Equations, (2008), pp. 1–7. https://www.math.u-szeged.hu/ejqtde/p305.pdf
- [9] F. Cao, Geometric Curve Evolution and Image Processing, Volume 1805 of Lecture Notes in Mathematics, Springer, Berlin, 2003.
- [10] V. Caselles, J.-M. Morel, G. Sapiro, and A. Tannenbaum, Introduction to the special issue on partial differential equations and geometry-driven diffusion in image processing and analysis, IEEE Trans. Image Process., 7 (1998) no. 3, pp. 269–273. https://doi.org/10.1109/TIP.1998.661176
- [11] R. Chouder and N. Benhamidouche, New exact solutions to nonlinear diffusion equation that occurs in image processing, International Journal of Computing Science and Mathematics, 10 (2019) no. 4, pp. 364-374. https://doi.org/10.1504/IJCSM.2019.10024353
- [12] R. Chouder and N. Benhamidouche, Travelling profile solutions for nonlinear degenerate parabolic equation and contour enhancement in image processing, Applied Mathematics E-Notes, 18 (2018), pp. 1-12. https://www.emis.de/journals/AMEN/2018/AMEN-161013.pdf
- [13] L.C. Evans and J. Spruck, Motion of level sets by mean curvature I, J. Differ. Geom., 33 (1991) no. 3, pp. 635–681. https://doi.org/10.1007/BF02921385
- [14] M. Hachama, and F. Boutaous, A fractional osmosis model for image fusion, Advances in Computational Mathematics, 50 (2024) no. 7.
- [15] G. Huisken, Flow by mean curvature of convex surfaces into spheres, Journal of Differential Geometry, 20 (1984), pp. 237-266. https://doi.org/10.4310/jdg/1214438998
- [16] M. Gage, Curve shortening makes convex curves circular, Inventions Mathematica, 76 (1984), pp. 357-364.
- [17] M. Gage and R. S. Hamilton, The heat equation shrinking convex plane curves, Journal of Differential Geometry, 23 (1986), pp. 69-96. https://doi.org/10.4310/jdg/1214439902
- [18] R. Kimmel, Numerical Geometry of Images: Theory, Algorithms, and Applications, Springer, New York, 2003.
- [19] R. Malladi and J. A. Sethian, Image processing via level set curvature flow, Proc. of Natl. Acad. of Scie., 92 (1995), pp. 7046–7050. https://doi.org/10.1073/pnas.92.15.7046
- [20] R. Malladi and J. A. Sethian, Image Processing: Flows under Min/Max curvature and Mean Curvature, Graphical Models and Image Processing, 58 (1996) no. 2, pp. 127-141.
- [21] M. Mondelli and A. Ciomaga, Finite difference schemes for MCM and AMSS, Image Processing On Line, 1 (2011).
- [22] S. J. Osher and J. A. Sethian, Fronts propagation with curvature dependent speed: Algorithms based on Hamilton-Jacobi formulations, J. Comput. Phys., 79 (1988), pp. 12–49. https://doi.org/10.5201/ipol.2011.cm_fds
- [23] P. Perona and J. Malik, Scale-space and edge detection using anisotropic diffusion, IEEE Trans. Pattern Anal. Mach. Intell., 12 (1990) no. 7, pp. 629–639. https://doi.org/10.1109/34.56205
- [24] G. Rosman, L. Dascal, A. Sidi, and R. Kimmel, Efficient Beltrami image filtering via vector extrapolation methods, SIAM J. Img. Sci., 2 (2009) no. 3, pp. 858–878. https://doi.org/10.1137/080728391
- [25] G. Rosman, L. Dascal, X. C. Tai and R. Kimmel, On semi-implicit splitting schemes for the Beltrami color image filtering , J. Math. Image. Vision, 40 (2011) no. 2, pp. 199–213. https://doi.org/10.1007/s10851-010-0254-y
- [26] G. Sapiro, Geometric Partial Differential Equations and Image Analysis, Cambridge University Press, Cambridge, UK, 2001. https://doi.org/10.1017/S0025557200173504
- [27] J. A. Sethian, An Analysis of Flame Propagation, Ph. D. Dissertation, University of California, 1982.
- [28] N. Sochen, R. Kimmel and R.Malladi, From high energy physics to low level vision, LBNL Report # 39243, Lawrence Berkeley National Laboratory, University of California, Berkeley, 1996.
- [29] N. Sochen, R. Kimmel and R. Malladi, A general framework for low level vision, IEEE Transactions on Image Processing, 7 (1998) no. 3, pp. 310–318. https://doi.org/10.1109/83.661181
- [30] J. Weickert, Anisotropic Diffusion in Image Processing, B. G. Teubner, Stuttgart, 1998.
- [31] J. Weickert, B.M. ter Haar Romeny and M.A. Viergever, Efficient and reliable scheme for nonlinear diffusion filtering, IEEE Trans on Image Processing, 7 (1998) no. 3, pp. 398-410. https://doi.org/10.1109/83.661190
- [32] M. Welk, and J. Weickert, PDE evolutions for M-smoothers in one, two, and three dimensions, Journal of Mathematical Imaging and Vision, 42 (2021) no. 2, pp. 157-185. https://doi.org/10.1007/s10851-020-00986-1
- [33] A. Yezzi, Modified curvature motion for image smoothing and enhancement, IEEE Transactions on Image Processing, 7 (1998) no. 3, pp. 345–352. https://doi.org/10.1109/83.661184
- [34] J. Zhang, K. Chen, F. Chen and B. Yu, An efficient numerical method for mean curvature-based image registration model, East Asian Journal on Applied Mathematics, 7 (2017) no. 1, pp. 125–142. https://doi.org/10.4208/eajam.200816.031216a
- [35]