In this paper,we mainly study the existence of solutions to sparsity constrained optimization(SCO).Based on the expressions of tangent cone and normal cone of sparsity constraint,we present and characterize two first-order necessary optimality conditions for SCO:N-stationarity and T-stationarity.Then we give the second-order necessary and sufficient optimality conditions for SCO.At last,we extend these results to SCO with nonnegative constraint.
The semidefinite matrix completion(SMC) problem is to recover a low-rank positive semidefinite matrix from a small subset of its entries. It is well known but NP-hard in general. We first show that under some cases, SMC problem and S1/2relaxation model share a unique solution. Then we prove that the global optimal solutions of S1/2regularization model are fixed points of a symmetric matrix half thresholding operator. We give an iterative scheme for solving S1/2regularization model and state convergence analysis of the iterative sequence.Through the optimal regularization parameter setting together with truncation techniques, we develop an HTE algorithm for S1/2regularization model, and numerical experiments confirm the efficiency and robustness of the proposed algorithm.
Regularized minimization problems with nonconvex, nonsmooth, even non-Lipschitz penalty functions have attracted much attention in recent years, owing to their wide applications in statistics, control,system identification and machine learning. In this paper, the non-Lipschitz ?_p(0 < p < 1) regularized matrix minimization problem is studied. A global necessary optimality condition for this non-Lipschitz optimization problem is firstly obtained, specifically, the global optimal solutions for the problem are fixed points of the so-called p-thresholding operator which is matrix-valued and set-valued. Then a fixed point iterative scheme for the non-Lipschitz model is proposed, and the convergence analysis is also addressed in detail. Moreover,some acceleration techniques are adopted to improve the performance of this algorithm. The effectiveness of the proposed p-thresholding fixed point continuation(p-FPC) algorithm is demonstrated by numerical experiments on randomly generated and real matrix completion problems.
This paper aims at achieving a simultaneously sparse and low-rank estimator from the semidefinite population covariance matrices.We first benefit from a convex optimization which develops l1-norm penalty to encourage the sparsity and nuclear norm to favor the low-rank property.For the proposed estimator,we then prove that with high probability,the Frobenius norm of the estimation rate can be of order O(√((slgg p)/n))under a mild case,where s and p denote the number of nonzero entries and the dimension of the population covariance,respectively and n notes the sample capacity.Finally,an efficient alternating direction method of multipliers with global convergence is proposed to tackle this problem,and merits of the approach are also illustrated by practicing numerical simulations.
Sheng-Long ZhouNai-Hua XiuZi-Yan LuoLing-Chen Kong
