Inexact Boosted Difference of Convex Algorithm
Main Article Content
Abstract
In this paper, we propose the Inexact Difference of Convex Algorithm (iBDCA), an inexact variant of the Boosted Difference of Convex Functions Algorithm (BDCA), to solve an optimization problem involving the difference of two strongly convex functions, where both components of the DC function are assumed to be differentiable and the gradient of the first component is Lipschitz continuous. The proposed algorithm consists of two main steps: First, we employ a gradient descent-based scheme to find an approximate solution to a subproblem related to the convex part of the DC function; second, this approximate point is then used to compute a suitable step size for the next iteration. The convergence and convergence rate of the iterates and the value sequence of the objective function to the optimal solution and the optimal value are established, along with the complexity of the subproblem.
Keywords
DC functions, boosted difference of convex functions algorithm, inexact gradient descent methods, convergence analysis, step size, line search.
Article Details
References
Aragón-Artacho, F. J., Mordukhovich, B. S., Pérez-Aros, P. (2024). Coderivative-based semi-Newton method in nonsmooth difference programming. Mathematical Programming, 1-48.
Fukushima, M., Mine, H. (1981). A generalized proximal point algorithm for certain non-convex minimization problems. International Journal of Systems Science, 12(8), 989-1000.
Izmailov, A. F., Solodov, M. V. (2014). Newton-type methods for optimization and variational problems (Vol. 1). Springer.
Khanh, P. D., Mordukhovich, B. S., & Tran, D. B. . (2024). A new inexact gradient descent method with applications to nonsmooth convex optimization. Optimization Methods and Software,, 1-29.
Lojasiewicz, S. (1965). Ensembles semi-analytiques. Lectures Notes IHES (Bures-sur-Yvette).
Tao, P. D. (1986). Algorithms for solving a class of nonconvex optimization problems. Methods of subgradients. North-Holland Mathematics Studies, (Vol. 129, pp. 249-271).
Tao, P. D., An, L. H. (1997). Convex analysis approach to DC programming: theory, algorithms and applications. Acta mathematica vietnamica, 22(1), 289-355.
Yin, P., Lou, Y., He, Q., Xin, J. (2015). Minimization of 1-2 for compressed sensing. SIAM Journal on Scientific Computing, 37(1), A536-A563.