Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userLocal convergence analysis of inexact Newton-like methods under majorant condition
113
0
0.0
(
0
)
Ask ChatGPT about the research
No Arabic abstract
We present a local convergence analysis of inexact Newton-like methods for solving nonlinear equations under majorant conditions. This analysis provides an estimate of the convergence radius and a clear relationship between the majorant function, which relaxes the Lipschitz continuity of the derivative, and the nonlinear operator under consideration. It also allow us to obtain some important special cases
rate research
Read More
We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function using proximal-gradient methods, where an error is present in the calculation of the gradient of the smooth term or in the proximity operator with respect to the non-smooth term. We show that both the basic proximal-gradient method and the accelerated proximal-gradient method achieve the same convergence rate as in the error-free case, provided that the errors decrease at appropriate rates.Using these rates, we perform as well as or better than a carefully chosen fixed error level on a set of structured sparsity problems.
For solving large-scale non-convex problems, we propose inexact variants of trust region and adaptive cubic regularization methods, which, to increase efficiency, incorporate various approximations. In particular, in addition to approximate sub-problem solves, both the Hessian and the gradient are suitably approximated. Using rather mild conditions on such approximations, we show that our proposed inexact methods achieve similar optimal worst-case iteration complexities as the exact counterparts. Our proposed algorithms, and their respective theoretical analysis, do not require knowledge of any unknowable problem-related quantities, and hence are easily implementable in practice. In the context of finite-sum problems, we then explore randomized sub-sampling methods as ways to construct the gradient and Hessian approximations and examine the empirical performance of our algorithms on some real datasets.
We propose a inexact Newton method for solving inverse eigenvalue problems (IEP). This method is globalized by employing the classical backtracking techniques. A global convergence analysis of this method is provided and the R-order convergence property is proved under some mild assumptions. Numerical examples demonstrate that the proposed method is very effective for solving the IEP with distinct eigenvalues.
In Wang et al. (J. Optim. Theory Appl., textbf{181}: 216--230, 2019), a class of effective modified Newton-tpye (MN) iteration methods are proposed for solving the generalized absolute value equations (GAVE) and it has been found that the MN iteration method involves the classical Picard iteration method as a special case. In the present paper, it will be claimed that a Douglas-Rachford splitting method for AVE is also a special case of the MN method. In addition, a class of inexact MN (IMN) iteration methods are developed to solve GAVE. Linear convergence of the IMN method is established and some specific sufficient conditions are presented for symmetric positive definite coefficient matrix. Numerical results are given to demonstrate the efficiency of the IMN iteration method.
In the present paper, we consider the semilocal convergence problems of the two-step Newton method for solving nonlinear operator equation in Banach spaces. Under the assumption that the first derivative of the operator satisfies a generalized Lipschitz condition, a new semilocal convergence analysis for the two-step Newton method is presented. The Q-cubic convergence is obtained by an additional condition. This analysis also allows us to obtain three important spacial cases about the convergence results based on the premises of Kantorovich, Smale and Nesterov-Nemirovskii types. An application of our convergence results is to the approximation of minimal positive solution for a nonsymmetric algebraic Riccati equation arising from transport theory.
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
