Inexact Boosted Difference of Convex Algorithm

Bui Ho Kim Anh1, , Pham Duy Khanh1, Tran Trung Tin1, Tran Ba Dat2
1 Ho Chi Minh City University of Education, Vietnam
2 Rowan University, The United States of America

Main Article Content

Abstract

In this paper, we propose the Inexact Difference of Convex Algorithm (iBDCA), an inexact variant of the Boosted Difference of Convex Functions Algorithm (BDCA), to solve an optimization problem involving the difference of two strongly convex functions, where both components of the DC function are assumed to be differentiable and the gradient of the first component is Lipschitz continuous. The proposed algorithm consists of two main steps: First, we employ a gradient descent-based scheme to find an approximate solution to a subproblem related to the convex part of the DC function; second, this approximate point is then used to compute a suitable step size for the next iteration. The convergence and convergence rate of the iterates and the value sequence of the objective function to the optimal solution and the optimal value are established, along with the complexity of the subproblem.

Article Details

References

Aragón Artacho, F. J., Fleming, R. M., Vuong, P. T. (2018). Accelerating the DC algorithm for smooth functions. Mathematical programming, 169,95-118.
Aragón-Artacho, F. J., Mordukhovich, B. S., Pérez-Aros, P. (2024). Coderivative-based semi-Newton method in nonsmooth difference programming. Mathematical Programming, 1-48.
Fukushima, M., Mine, H. (1981). A generalized proximal point algorithm for certain non-convex minimization problems. International Journal of Systems Science, 12(8), 989-1000.
Izmailov, A. F., Solodov, M. V. (2014). Newton-type methods for optimization and variational problems (Vol. 1). Springer.
Khanh, P. D., Mordukhovich, B. S., & Tran, D. B. . (2024). A new inexact gradient descent method with applications to nonsmooth convex optimization. Optimization Methods and Software,, 1-29.
Lojasiewicz, S. (1965). Ensembles semi-analytiques. Lectures Notes IHES (Bures-sur-Yvette).
Tao, P. D. (1986). Algorithms for solving a class of nonconvex optimization problems. Methods of subgradients. North-Holland Mathematics Studies, (Vol. 129, pp. 249-271).
Tao, P. D., An, L. H. (1997). Convex analysis approach to DC programming: theory, algorithms and applications. Acta mathematica vietnamica, 22(1), 289-355.
Yin, P., Lou, Y., He, Q., Xin, J. (2015). Minimization of 1-2 for compressed sensing. SIAM Journal on Scientific Computing, 37(1), A536-A563.