Second-order cone programming explained

A second-order cone program (SOCP) is a convex optimization problem of the form

minimize

fTx

subject to

\lVertAix+bi\rVert2\leq

T
c
i

x+di,i=1,...,m

Fx=g

where the problem parameters are

f\inRn,Ai\in

{ni
R

x n},bi\in

ni
R

,ci\inRn,di\inR,F\inRp x

, and

g\inRp

.

x\inRn

is the optimization variable.

\lVertx\rVert2

is the Euclidean norm and

T

indicates transpose.[1] The "second-order cone" in SOCP arises from the constraints, which are equivalent to requiring the affine function

(Ax+b,cTx+d)

to lie in the second-order cone in
ni+1
R
.[1]

SOCPs can be solved by interior point methods[2] and in general, can be solved more efficiently than semidefinite programming (SDP) problems. Some engineering applications of SOCP include filter design, antenna array weight design, truss design, and grasping force optimization in robotics.[3] Applications in quantitative finance include portfolio optimization; some market impact constraints, because they are not linear, cannot be solved by quadratic programming but can be formulated as SOCP problems.[4] [5] [6]

Second-order cone

The standard or unit second-order cone of dimension

n+1

is defined as

l{C}n+1=\left\{\begin{bmatrix}x\t\end{bmatrix}|x\inRn,t\inR,\|x\|2\leqt\right\}

.

The second-order cone is also known by quadratic cone or ice-cream cone or Lorentz cone. The standard second-order cone in

R3

is

\left\{(x,y,z)|\sqrt{x2+y2}\leqz\right\}

.

The set of points satisfying a second-order cone constraint is the inverse image of the unit second-order cone under an affine mapping:

\lVertAix+bi\rVert2\leq

T
c
i

x+di\Leftrightarrow\begin{bmatrix}Ai

T
\c
i

\end{bmatrix}x+\begin{bmatrix}bi\di\end{bmatrix}\in

l{C}
ni+1

and hence is convex.

The second-order cone can be embedded in the cone of the positive semidefinite matrices since

||x||\leqt\Leftrightarrow\begin{bmatrix}tI&x\xT&t\end{bmatrix}\succcurlyeq0,

i.e., a second-order cone constraint is equivalent to a linear matrix inequality (Here

M\succcurlyeq0

means

M

is semidefinite matrix). Similarly, we also have,

\lVertAix+bi\rVert2\leq

T
c
i

x+di\Leftrightarrow\begin{bmatrix}

T
(c
i

x+di)I&Aix+bi\(Aix+

T
b
i)

&

T
c
i

x+di\end{bmatrix}\succcurlyeq0

.

Relation with other optimization problems

When

Ai=0

for

i=1,...,m

, the SOCP reduces to a linear program. When

ci=0

for

i=1,...,m

, the SOCP is equivalent to a convex quadratically constrained linear program.

Convex quadratically constrained quadratic programs can also be formulated as SOCPs by reformulating the objective function as a constraint. Semidefinite programming subsumes SOCPs as the SOCP constraints can be written as linear matrix inequalities (LMI) and can be reformulated as an instance of semidefinite program. The converse, however, is not valid: there are positive semidefinite cones that do not admit any second-order cone representation.[7] In fact, while any closed convex semialgebraic set in the plane can be written as a feasible region of a SOCP,[8] it is known that there exist convex semialgebraic sets that are not representable by SDPs, that is, there exist convex semialgebraic sets that can not be written as a feasible region of a SDP.[9]

Examples

Quadratic constraint

Consider a convex quadratic constraint of the form

xTAx+bTx+c\leq0.

This is equivalent to the SOCP constraint

\lVertA1/2x+

1
2

A-1/2b\rVert\leq\left(

1
4

bTA-1b-c

1
2
\right)

Stochastic linear programming

Consider a stochastic linear program in inequality form

minimize

cTx

subject to

Tx
P(a
i

\leqbi)\geqp,i=1,...,m

where the parameters

ai

are independent Gaussian random vectors with mean

\bar{a}i

and covariance

\Sigmai

and

p\geq0.5

. This problem can be expressed as the SOCP

minimize

cTx

subject to

T
\bar{a}
i

x+\Phi-1(p)\lVert

1/2
\Sigma
i

x\rVert2\leqbi,i=1,...,m

where

\Phi-1()

is the inverse normal cumulative distribution function.[1]

Stochastic second-order cone programming

We refer to second-order cone programsas deterministic second-order cone programs since data defining them are deterministic.Stochastic second-order cone programs are a class of optimization problems that are defined to handle uncertainty in data defining deterministic second-order cone programs.[10]

Other examples

Other modeling examples are available at the MOSEK modeling cookbook.[11]

Solvers and scripting (programming) languages

NameLicenseBrief info
AMPLcommercialAn algebraic modeling language with SOCP support
Artelys Knitrocommercial
Clarabelopen sourceNative Julia and Rust SOCP solver. Can solve convex problems with arbitrary precision types.
CPLEXcommercial
CVXPYopen sourcePython modeling language with support for SOCP. Supports open source and commercial solvers.
CVXOPTopen sourceConvex solver with support for SOCP
ECOSopen sourceSOCP solver optimized for embedded applications
FICO Xpresscommercial
Gurobi Optimizercommercial
MATLABcommercialThe coneprog function solves SOCP problems[12] using an interior-point algorithm[13]
MOSEKcommercialparallel interior-point algorithm
NAG Numerical LibrarycommercialGeneral purpose numerical library with SOCP solver
SCSopen sourceSCS (Splitting Conic Solver) is a numerical optimization package for solving large-scale convex quadratic cone problems.

See also

Notes and References

  1. Book: Boyd . Stephen . Vandenberghe . Lieven . Convex Optimization . Cambridge University Press . 2004 . 978-0-521-83378-3 . July 15, 2019.
  2. Potra. lorian A.. Wright. Stephen J.. 1 December 2000. Interior-point methods. Journal of Computational and Applied Mathematics. 124. 1–2. 281–302. 10.1016/S0377-0427(00)00433-7. 2000JCoAM.124..281P.
  3. Lobo. Miguel Sousa. Vandenberghe. Lieven. Boyd. Stephen. Lebret. Hervé. 1998. Applications of second-order cone programming. Linear Algebra and Its Applications. en. 284. 1–3. 193–228. 10.1016/S0024-3795(98)10032-0. free.
  4. Web site: Solving SOCP .
  5. Web site: portfolio optimization .
  6. Book: Li . Haksun . Numerical Methods Using Java: For Data Science, Analysis, and Engineering . 16 January 2022 . APress . Chapter 10 . 978-1484267967 .
  7. Fawzi. Hamza. 2019. On representing the positive semidefinite cone using the second-order cone. Mathematical Programming. en. 175. 1–2. 109–118. 10.1007/s10107-018-1233-0. 0025-5610. 1610.04901. 119324071.
  8. Scheiderer. Claus. 2020-04-08. Second-order cone representation for convex subsets of the plane. math.OC. 2004.04196.
  9. Scheiderer. Claus. 2018. Spectrahedral Shadows. SIAM Journal on Applied Algebra and Geometry. en. 2. 1. 26–44. 10.1137/17M1118981. 2470-6566. free.
  10. Alzalg . Baha M. . 2012-10-01 . Stochastic second-order cone programming: Applications models . Applied Mathematical Modelling . en . 36 . 10 . 5122–5134 . 10.1016/j.apm.2011.12.053 . 0307-904X.
  11. Web site: MOSEK Modeling Cookbook - Conic Quadratic Optimization .
  12. Web site: Second-order cone programming solver - MATLAB coneprog . MathWorks . 2021-03-01 . 2021-07-15.
  13. Web site: Second-Order Cone Programming Algorithm - MATLAB & Simulink . MathWorks . 2021-03-01 . 2021-07-15.
  14. Web site: MOSEK Modeling Cookbook - the Power Cones .