# Exact algorithms for linear matrix inequalities

Exact algorithms for linear matrix inequalities Didier Henrion Simone Naldiy Mohab Safey El Dinz September 8, 2016 ... improvements with respect to st...

Exact algorithms for linear matrix inequalities Didier Henrion∗

Simone Naldi†

Mohab Safey El Din‡

September 8, 2016

Abstract Let A(x) = A0 + x1 A1 + · · · + xn An be a linear matrix, or pencil, generated by given symmetric matrices A0 , A1 , . . . , An of size m with rational entries. The set of real vectors x such that the pencil is positive semidefinite is a convex semialgebraic set called spectrahedron, described by a linear matrix inequality (LMI). We design an exact algorithm that, up to genericity assumptions on the input matrices, computes an exact algebraic representation of at least one point in the spectrahedron, or decides that it is empty. The algorithm does not assume the existence of an interior point, and the computed point minimizes the rank of the pencil on the spectrahedron. The degree d of the algebraic representation of the point coincides experimentally with the algebraic degree of a generic semidefinite program associated to the pencil. We provide explicit bounds for the complexity of our algorithm, proving that the maximum number of arithmetic operations that are performed is essentially quadratic in a multilinear B´ezout bound of d. When m (resp. n) is fixed, such a bound, and hence the complexity, is polynomial in n (resp. m). We conclude by providing results of experiments showing practical improvements with respect to state-of-the-art computer algebra algorithms.

Keywords: linear matrix inequalities, semidefinite programming, computer algebra algorithms, symbolic computation, polynomial optimization.

1

Introduction

Let Sm (Q) be the vector space of m × m symmetric matrices with entries in Q. Let A0 , A1 , . . . , An ∈ Sm (Q) and A(x) = A0 +x1 A1 +· · ·+xn An be the associated linear matrix, x = (x1 , . . . , xn ) ∈ Rn . We also denote the tuple (A0 , A1 , . . . , An ) by A ∈ Sn+1 m (Q). For n x ∈ R , A(x) is symmetric, with real entries, and hence its eigenvalues are real numbers. ∗ LAAS-CNRS, Universit´e de Toulouse, CNRS, Toulouse, France; Faculty of Electrical Engineering, Czech Technical University in Prague, Czech Republic. † LAAS-CNRS, Universit´e de Toulouse, CNRS, Toulouse, France. ‡ Sorbonne Universit´es, UPMC Univ Paris 06, CNRS, INRIA Paris Center, LIP6, Equipe PolSys, F-75005, Paris, France.

1

The central object of this paper is the subset of x ∈ Rn such that the eigenvalues of A(x) are all nonnegative, that is the spectrahedron S = {x ∈ Rn : A(x)  0}. Here  0 means “positive semidefinite” and A(x)  0 is called a linear matrix inequality (LMI). The set S is convex closed basic semi-algebraic. This paper addresses the following decision problem for the spectrahedron S : Problem 1 (Feasibility of semidefinite programming) Compute an exact algebraic representation of at least one point in S , or decide that S is empty. We present a probabilistic exact algorithm for solving Problem (1). The algorithm depends on some assumptions on input data that are specified later. If S is not empty, the expected output is a rational parametrization (see e.g. [55]) of a finite set Z ⊂ Cn meeting S in at least one point x∗ . This is given by a vector (q0 , . . . , qn+1 ) ⊂ Z[t]n+2 and a linear form λ = λ1 x1 + · · · + λn xn ∈ Q[t] such that deg(qn+1 ) = ]Z, deg(qi ) < deg(qn+1 ) for 0 ≤ i ≤ n, gcd(qn+1 , q0 ) = 1 and Z coincides with the set {(x1 , . . . , xn ) ∈ Cn | t = λ1 x1 + · · · + λn xn , qn+1 (t) = 0, xi = qi (t)/q0 (t)}

(1)

n+1 for a A few remarks on this representation are in order. Usually, q0 is taken as ∂q∂t better control on the size of the coefficients [14, Theorem 1] – see also the introductory discussion of that theorem in [14]. More precisely, if D bounds the degrees of a finite family of polynomials in Z[x1 , . . . , xn ] defining Z and h bounds the bit size of their coefficients and those of λ, then the coefficients of a rational parametrization encoding Z have bit size bounded by hDn .

This is to be compared with polynomial parametrizations where the rational fractions qi /q0 are replaced by polynomials pi ; they are obtained by inverting q0 w.r.t. qn+1 using the extended Euclidean algorithm. That leads to polynomials pi with bit size bounded by hD2n . In order to compute such representations, the usual and efficient strategy is to compute first the image of such representations in a prime field and next use a Newton-Hensel lifting to recover the integers. According to [23, Lemma 4] and the above bounds, the cost of lifting integers is log-linear in the output size. Since in the case of polynomial parametrizations, the output size may be Dn times larger than in the case of rational parametrizations, rational parametrizations are easier to compute. In addition, observe from [45, Lemma 3.4 and Theorem 3.12] that isolating boxes for the real points in Z from rational or polynomial representations have the same bit complexity (e.g. cubic in the degree of q and log-linear in the maximum bit size of the coefficients in the parametrization). As an outcome of designing our algorithm, we also compute the minimum rank attained by the pencil on the spectrahedron. Moreover, since the points in Z are in one-toone correspondence with the roots of qn+1 , from this representation the coordinates of the feasible point x∗ ∈ S can be computed with arbitrary precision by isolating the corresponding solution t∗ of the univariate equation qn+1 (t) = 0. If S is empty, the expected output is the empty list. 2

1.1

Motivations

Semidefinite programming models a large number of problems in the applications [53, 10, 8]. This includes one of the most important questions in computational algebraic geometry, that is the general polynomial optimization problem. Indeed, Lasserre [42] proved that the problem of minimizing a polynomial function over a semi-algebraic set can be relaxed to a sequence of primal-dual semidefinite programs called LMI relaxations, and that under mild assumptions the sequence of solutions converge to the original minimum. Generically, solving a non-convex polynomial optimization problem amounts to solving a finite-dimensional convex semidefinite programming problem [47]. Numerical algorithms following this approach are available and, typically, guarantees of their convergence are related to the feasibility (or strict feasibility) of the LMI relaxations. It is, in general, a challenge to obtain exact algorithms for deciding whether the feasible set of a semidefinite programming (SDP) problem min

x∈Rn

n X

s.t. A(x)  0

ci x i

(2)

i=1

is empty or not. The feasible set of the SDP (2) is defined by an LMI and hence it is a spectrahedron. Problem (1) amounts to solving the feasibility problem for semidefinite programming, in exact arithmetic: given a Q−definable semidefinite program as in (2) (that is, we suppose that the coefficients of A(x) have rational entries), decide whether the feasible set S = {x ∈ Rn : A(x)  0} is empty or not, and compute exactly at least one feasible point. We would like to emphasize the fact that we do not assume the existence of an interior point in S . Quite the opposite, we are especially interested in degenerate cases for which the maximal rank achieved by the pencil A(x) in S is small. This work is a first step towards an exact approach to semidefinite programming. In particular, a natural perspective of this work is to design exact algorithms for deciding whether the minimum in (2) is attained or not, and for computing such a minimum in the affirmative case. While the number of iterations performed by the ellipsoid algorithm [27] to compute the approximation of a solution of (2) is polynomial in the number of variables, once the accuracy is fixed, no analogous results for exact algorithms are available. Moreover, since the intrinsic complexity of the optimization problem (2) is related to its algebraic degree δ as computed in [48, 24], the paramount goal is to design algorithms whose runtime is polynomial in δ. The algorithm of this paper shows experimentally such an optimal behavior with respect to δ. We finally recall that solving LMIs is a basic subroutine of computer algorithms in systems control and optimization, especially in linear systems robust control [9, 33], but also for the analysis or synthesis of nonlinear dynamical systems [67], or in nonlinear optimal control with polynomial data [37, 11].

1.2

Contribution and outline

We design a computer algebra algorithm for solving the feasibility problem of semidefinite programming, that is Problem (1), in exact arithmetic. Let us clarify that we do not 3

claim that an exact algorithm can be competitive with a numerical algorithm in terms of admissible size of input problems: indeed, SDP solvers based on interior-point methods [7, 46] can nowadays handle inputs with a high number of variables that are out of reach for our algorithms. Our contribution can be summarized as follows: 1. we show that the geometry of spectrahedra understood as semi-algebraic sets with determinantal structure can be exploited to design dedicated computer algebra algorithms; 2. we give explicit complexity and output-degree upper bounds for computer algebra algorithms solving exactly the feasibility problem of semidefinite programming; our algorithm is probabilistic and works under assumptions on the input, which are generically satisfied; 3. we provide results of practical experiments showing the gain in terms of computational timings of our contribution with respect to the state of the art in computer algebra; 4. remarkably, our algorithm does not assume that the input spectrahedron S = {x ∈ Rn : A(x)  0} is full-dimensional, and hence it can tackle also examples with empty interior. The main idea is to exploit the relation between the geometry of spectrahedra, and that of the determinantal varieties associated to the input symmetric pencil A(x). Let us introduce, for r = 0, . . . , m − 1, the algebraic sets Dr = {x ∈ Cn : rank A(x) ≤ r}. These define a nested sequence D0 ⊂ D1 ⊂ · · · ⊂ Dm−1  . The dimension of Dr for generic linear matrices A is known, and equals n − m−r+1 (see Lemma 4). The Euclidean 2 boundary ∂S of S is included in the real trace of the last algebraic set of the sequence: ∂S ⊂ Dm−1 ∩ Rn . In particular, for x ∈ ∂S , the matrix A(x) is singular and one could ask which elements of the real nested sequence D0 ∩ Rn ⊂ · · · ⊂ Dm−1 ∩ Rn intersect ∂S . Notation 1 If S = {x ∈ Rn : A(x)  0} is not empty, we define the integer r(A) = min {rank A(x) : x ∈ S } . When S is not empty, r(A) equals the minimum integer r such that Dr ∩ Rn intersects S . We present our first main result, which states that S contains at least one of the connected components of the real algebraic set Dr(A) ∩ Rn . We denote by Sn+1 m (Q) = Sm (Q) × · · · × Sm (Q) the (n + 1)−fold Cartesian product of Sm (Q). Theorem 2 (Smallest rank on a spectrahedron) Suppose that S 6= ∅. Let C be a connected component of Dr(A) ∩ Rn such that C ∩ S 6= ∅. Then C ⊂ S and hence C ⊂ (Dr(A) \ Dr(A)−1 ) ∩ Rn .

4

We give a proof of Theorem 2 in Section 2. From Theorem 2, we deduce the following mutually exclusive conditions on the input symmetric linear pencil A: either S = ∅, or S contains one connected component C of Dr(A) ∩ Rn . Consequently, an exact algorithm whose output is one point in the component C ⊂ S ∩ Dr(A) would be sufficient for our goal. Motivated by this fact, we design in Section 3.2 an exact algorithm computing one point in each connected component of Dr ∩ Rn , for r ∈ {0, . . . , m − 1}. The strategy to compute sample points in Dr ∩ Rn is to build an algebraic set Vr ⊂ Cn+m(m−r) whose projection on the first n variables is contained in Dr . This set is defined by the incidence bilinear relation A(x)Y (y) = 0 where Y (y) is a full-rank m × (m − r) linear matrix whose columns generate the kernel of A(x) (cf. Section 3.1). Unlike Dr , the incidence variety Vr , up to genericity conditions on the matrices A0 , A1 , . . . , An , turns to be generically smooth and equidimensional. The next theorem presents a complexity result for an exact algorithm solving Problem (1) under these genericity assumptions. Theorem 3 (Exact algorithm for LMI) Suppose that for 0 ≤ r ≤ m − 1, the incidence variety Vr is smooth and equidimensional and that its defining polynomial system generates a radical ideal. Suppose that Dr has the expected dimension n − m−r+1 . There 2 is a probabilistic algorithm that takes A as input and returns: 1. either the empty list, if and only if S = ∅, or 2. a vector x∗ such that A(x∗ ) = 0, if and only if the linear system A(x) = 0 has a solution, or 3. a rational parametrization q = (q0 , . . . , qn+1 ) ⊂ Z[t] such that there exists t∗ ∈ R with qn+1 (t∗ ) = 0 and: • A(q1 (t∗ )/q0 (t∗ ), . . . , qn (t∗ )/q0 (t∗ ))  0 and • rank A(q1 (t∗ )/q0 (t∗ ), . . . , qn (t∗ )/q0 (t∗ )) = r(A). The number of arithmetic operations performed are in  m2 +m O˜ n

2

n

+n

! 6 X   m (n + (m − r)(m + 3r))7 . r r≤m−1

If S 6= ∅, the degree of q is in O



3

m2 +m +n 2

n

 .

An important aspect of our contribution can be read from the complexity and degree bounds in Theorem 3: indeed, remark that when m is fixed, both the output degree and the complexity of the algorithm are polynomial functions of n. Viceversa, by the constraint n ≥ m−r+1 (given by Lemma 4), one also easily deduces that when n is fixed, 2 the complexity is polynomial in m. The algorithm of Theorem 3 is described in Section 3. Its probabilistic nature comes from random changes of variables performed during the procedure, allowing to put the sets Dr 5

in generic position. We prove that for generic choices of parameters the output of the algorithm is correct. A complexity analysis is performed in Section 5. Bounds in Theorem 3 are explicit expressions involving m and n. These are computed by exploiting the multilinearity of intermediate polynomial systems generated during the procedure, and are not sharp in general. By experiments on randomly generated symmetric pencils, reported in Section 6, we observe that the output degree coincides with the algebraic degree of generic semidefinite programs, that is with data given in [48, Table 2]: this evidences the optimality of our approach. We did not succeed in proving exact formulas for such degrees.

1.3

Related works

On input A, S can be defined by m polynomial inequalities in Q[x1 , . . . , xn ] of degree ≤ m (see e.g. [51]). As far as we know, the state-of-the-art for designing algorithms deciding the emptiness of S consists only of algorithms for deciding the emptiness of general semi-algebraic sets; our contribution being the first attempt to exploit structural properties of the problem, e.g. through the smallest rank property (Theorem 2). A first algorithmic solution to deciding the emptiness of general semi-algebraic sets is given by Cylindrical Algebraic Decomposition algorithm [12]; however its runtime is doubly exponential in the number n of variables. The first singly exponential algorithm is given in [26], and has led to a series of works (see e.g. [54, 31]) culminating with algorithms designed in [5] based on the so-called critical points method. This method is based on the general idea which consists in computing minimizers/maximizers of a well-chosen function reaching its extrema in each connected component of the set under study. Applying [5] to problem (1) requires mO(n) bit operations. Note that our technique for dealing with sets Vr is based on the idea underlying the critical point method. Also, in the arithmetic complexity model, our complexity estimates are more precise (the complexity constant in the exponent is known) and better. This technique is also related to algorithms based on polar varieties for grabbing sample points in semi-algebraic sets; see for example [2, 3, 58, 59] and its application to polynomial optimization [25]. To get a purely algebraic certificate of emptiness for S , one could use the classical approach by Positivstellensatz [43, 52, 64]. As a snake biting its tail, this would lead to a family, or hierarchy, of semidefinite programs [42]. Bounds for the degree of Positivstellensatz certificates are exponential in the number of variables and have been computed in [65] for Schmudgen’s, and in [49] for Putinar’s formulation. In the recent remarkable result [44], a uniform 5−fold exponential bound for the degree of the Hilbert 17th problem is provided. In [41], an emptiness certificate dedicated to the spectrahedral case, by means of special quadratic modules associated to these sets, is obtained. All the above algorithms do not exploit the particular structure of spectrahedra understood as determinantal semi-algebraic sets. In [40], the authors showed that deciding 2 emptiness of S can be done in time O(nm4 ) + mO(min(n,m )) , that is in polynomial time in m (resp. linear time in n) if n (resp. m) is fixed. The main drawback of this algorithm is that it is based on general procedures for quantifier elimination, and hence it does not lead to efficient practical implementations. Note also that the complexity constant in the 6

exponent is still unknown. Also, in [28], a version of [57] dedicated to spectrahedra exploiting some of their structural properties, decides whether a linear matrix inequality A(x)  0 has a rational solution, that is whether S contains a point with coordinates in Q. Remark that such an algorithm is not sufficient to solve our problem, since, in some degenerate but interesting cases, S is not empty but does not contain rational points: in Section 6.2 we will illustrate the application of our algorithm to one of these examples. As suggested by the smallest rank property, determinantal structures play an important role in our algorithm. This structure has been recently exploited in [18] and [22] for the fast computation of Gr¨obner bases of zero-dimensional determinantal ideals and computing zero-dimensional critical loci of maps restricted to varieties in the generic case. Exploiting determinantal structures for determinantal situations remained challenging for a long time. In [34] we designed a dedicated algorithm for computing sample points in the real solution set of the determinant of a square linear matrix. This has been extended in [36] to real algebraic sets defined by rank constraints on a linear matrix. Observe that this problem looks similar to the ones we consider thanks to the smallest rank property. As in this paper, the traditional strategy consists in studying incidence varieties for which smoothness and regularity properties are proved under some genericity assumptions on the input linear matrix. Hence, in the case of symmetric matrices, these results cannot be used anymore. Because of the structure of the matrix, the system defining the incidence variety involves too many equations; some of them being redundant. Hence, these redundancies need to be eliminated to characterize critical points on incidence varieties in a convenient way. In the case of Hankel matrices, the special structure of their kernel provides an efficient way to do that. This case study is done in [35]. Yet, the problem of eliminating these redundancies remained unsolved in the general symmetric case and this is what we do in Section 3 which is the starting point of the design of our dedicated algorithm.

1.4

Basic notation

We refer to [6, 13, 30, 16] for the algebraic-geometric background of this paper. We recall below some basic definitions and notation. We denote by Mp,q (Q) the space of p × q rational matrices, and GLn (C) the set of n × n non-singular matrices. The transpose of M ∈ Mp,q (Q) is M T . The cardinality of a finite set T (resp. the number of entries of a vector v) are denoted by ]T (resp. ]v). Let x = (x1 , . . . , xn ). A vector f = (f1 , . . . , fs ) ⊂ Q[x] is a polynomial system, hf i ⊂ Q[x] its ideal and Z(hf i) = {x ∈ Cn : fi (x) = 0, i = 1, . . . , s} the associated algebraic set. Sets Z(hf i) define the collection of closed sets of the Zariski topology of Cn . The intersection of a Zariski closed and a Zariski open set is called a locally closed set. For M ∈ GLn (C) and Z ⊂ Cn , let M −1 Z = {x ∈ Cn : M x ∈ Z}. With I(S) we denote the ideal of polynomials vanshing on S ⊂ Cn . Let f = (f1 , . . . , fs ) ⊂ Q[x]. Its Jacobian matrix is denoted by Df = (∂fi /∂xj )i,j . An algebraic set Z ⊂ Cn is irreducible if Z = Z1 ∪ Z2 where Z1 , Z2 are algebraic sets, 7

implies that either Z = Z1 or Z = Z2 . Any algebraic set is the finite union of irreducible algebraic sets, called its irreducible components. The codimension c of an irreducible algebraic set Z ⊂ Cn is the maximum rank of Df on Z, where I(Z) = hf i. Its dimension is n − c. If all the irreducible components of Z have the same dimension, we say that Z is equidimensional. The dimension of an algebraic set Z is the maximum of the dimensions of its irreducible components, and it is denoted by dim Z. The degree of an equidimensional algebraic set Z of codimension c is the maximum cardinality of finite intersections Z ∩ L where L is a linear space of dimension c. The degree of an algebraic set is the sum of the degrees of its equidimensional components. Let Z ⊂ Cn be equidimensional of codimension c, and let I(Z) = hf1 , . . . , fs i. The singular locus of Z, denoted by sing (Z), is the algebraic set defined by f = (f1 , . . . , fs ) and by all c × c minors of Df . If sing (Z) = ∅ we say that Z is smooth, otherwise singular. The points in sing (Z) are called singular, while points in reg (Z) = Z \ sing (Z) are called regular. Let Z ⊂ Cn be smooth and equidimensional of codimension c, and let I(Z) = hf1 , . . . , fs i. Let g : Cn → Cm be an algebraic map. The set of critical points of the restriction of g to Z is the algebraic set denote by crit (g, Z) and defined by f = (f1 , . . . , fs ) and by all c + m minors of the Jacobian matrix D(f, g). The points in g(crit (g, Z)) are called critical values, while points in Cm \ g(crit (g, Z)) are called the regular values, of the restriction of g to Z.

2

The smallest rank on a spectrahedron

We prove Theorem 2, which relates the geometry of linear matrix inequalities to the rank stratification of the defining symmetric pencil. We believe that the statement of this theorem is known to the community of researchers working on real algebraic geometry and semidefinite optimization; however, we did not find any explicit reference in the literature. Proof of Theorem 2: By assumption, the rank of A(x) on S is greater or equal than r(A). We consider the vector function e = (e1 , . . . , em ) : Rn −→ Rm where e1 (x) ≤ . . . ≤ em (x) are the ordered eigenvalues of A(x). Let C be a connected component of Dr(A) ∩ Rn such that C ∩ S 6= ∅, and let x ∈ C ∩ S . One has rank A(x) = r(A) and e1 (x) = . . . = em−r(A) (x) = 0 < em−r(A)+1 (x) ≤ . . . ≤ em (x). Suppose ad absurdum that there exists y ∈ C such that y ∈ / S . In particular, one eigenvalue of A(y) is strictly negative. Let g : [0, 1] → C be a continuous semi-algebraic map such that g(0) = x and g(1) = y. This map exists since C is a connected component of a real algebraic set. The image g([0, 1]) is compact and semi-algebraic. Let T = {t ∈ [0, 1] : g(t) ∈ S } = g −1 (g([0, 1]) ∩ S ). Since g is continuous, T ⊂ [0, 1] is closed. So it is a finite union of closed intervals. Since 0 ∈ T (g(0) = x ∈ S ) there exists t0 ∈ [0, 1] and N ∈ N such that [0, t0 ] ∈ T / T . One gets that g(t0 ) = x˜ ∈ S and that for all p ≥ N , and for all p ≥ N , t0 + p1 ∈ 1 g(t0 + p ) = x˜p ∈ / S . By definition, x˜, x˜p ∈ C ⊂ Dr(A) ∩ Rn for all p ≥ N , and since x˜ ∈ S , we get rank A(˜ x) = r(A) and rank A(˜ xp ) ≤ r(A) for all p ≥ N . We also get that 8

rank A(g(t)) = r(A) for all t ∈ [0, t0 ]. We finally have x˜p → x˜ when p → +∞, since g is continuous. There exists a map n o ϕ: p ∈ N : p ≥ N → Z which assigns to p the index of eigenvalue-function among e1 , . . . , em corresponding to the maximum strictly negative eigenvalue of A(˜ xp ), if it exists, otherwise it assigns 0. Remark that since rank A(˜ xp ) ≤ r(A) for all p, then ϕ(p) ≤ r(A) for all p. In other words, the eigenvalues of A(˜ xp ) satisfy e1 (˜ xp ) ≤ . . . ≤ eϕ(p) (˜ xp ) < 0 = eϕ(p)+1 (˜ xp ) = . . . = eϕ(p)+m−r(A) (˜ xp ) 0 ≤ eϕ(p)+m−r(A)+1 (˜ xp ) ≤ . . . ≤ em (˜ xp ), for p ≥ N . Since the sequence {ϕ(p)}p≥N is bounded, up to taking a subsequence, it admits at least a limit point by the Bolzano-Weierstrass Theorem [4, Th. 3.4.8], this point is an integer, and j 7→ ϕ(j) is constant for large j. Suppose that there exists a limit point ` > 0, and let {pj }j∈N such that ϕ(pj ) → ` and that for j ≥ N 0 , j 7→ ϕ(pj ) is constant. xpj ) for all j ≥ N 0 . Since x˜pj → x˜, and since Thus, 0 = e`+1 (˜ xpj ) = . . . = e`+m−r(A) (˜ e1 , . . . , em are continuous functions, we obtain that ` = 0 is the unique limit point of ϕ, hence ϕ converges to 0. Hence ϕ ≡ 0 for large p. This contradicts the fact that x˜p ∈ /S for large p. We conclude that the set C \ S is empty, that is C ⊂ S . By the minimality of the integer r(A) in {rank A(x) : x ∈ S }, one deduces that C ⊂ (Dr(A) \ Dr(A)−1 ) ∩ Rn . 

3

Algorithm

Our algorithm is called SolveLMI, and it is presented in Section 3.3. Before, we describe in Section 3.2 its main subroutine LowRankSym, which is of recursive nature and computes one point per connected component of the real algebraic set Dr ∩ Rn . We start, in the next section, with some preliminaries.

3.1

Preliminaries

Expected dimension of low rank loci We first recall a known fact about the dimension of Dr , when A is a generic symmetric pencil. Lemma 4 There exists a non-empty Zariski open subset A ⊂ Sn+1 m (C) such that, if n+1 A ∈ A ∩ Sm (Q), for all r = 0, . . . , m − 1, the set Dr is either empty or it has dimension n − m−r+1 . 2 Proof : The proof is classical and can be found e.g. in [1, Prop. 3.1]. 9



Incidence varieties Let A(x) be a symmetric m × m linear matrix, and let 0 ≤ r ≤ m − 1. Let y = (yi,j )1≤i≤m,1≤j≤m−r be unknowns. Below, we build an algebraic set whose projection on the x−space is contained in Dr . Let   y1,1 · · · y1,m−r   .. Y (y) =  ... , . ym,1 · · · ym,m−r and let ι = {i1 , . . . , im−r } ⊂ {1, . . . , m}, with ]ι = m − r. We denote by Yι the (m − r) × (m − r) sub-matrix of Y (y) obtained by isolating the rows indexed by ι. There are mr such matrices. We define the set Vr (A, ι) = {(x, y) ∈ Cn × Cm(m−r) : A(x)Y (y) = 0, Yι − Im−r = 0}. We denote by f (A, ι), or simply by f , when there is no ambiguity on ι, the polynomial system defining Vr (A, ι). We often consider linear changes of variables x: for M ∈ GLn (C), f (A ◦ M, ι) denotes the entries of A(M x)Y (y) and Yι − Im−r , and by Vr (A ◦ M, ι) its zero set. We also denote by Uι ∈ Mm−r,m (Q) the full rank matrix whose entries are in {0, 1}, and such that Uι Y (y) = Yι . By simplicity we call Uι the boolean matrix with multi-index ι. By definition, the projection of Vr (A, ι) on the first n variables is contained in Dr . We remark the similarity between the relation A(x)Y (y) = 0 and the so-called complementarity condition for a couple of primal-dual semidefinite programs, see for example [48, Th. 3]. The difference in our model is that the special size of Y (y) and the affine constraint Yι = Im−r force a rank condition on Y (y) and hence on A(x). Eliminating redundancies The system f (A, ι) contains redundancies induced by polynomial relations between its generators. These relations can be explicitly eliminated in order to obtain a minimal polynomial system defining Vr . Lemma 5 Let M ∈ GLn (C). Let ι ⊂ {1, . . . , m}, with ]ι = m − r. Let A ∈ Sn+1 m (Q), m(m−r)+(m−r)2 and f ∈ Q[x, y] be the polynomial system defined in Section 3.1.  Then we can explicitly construct a subsystem fred ⊂ f of length m(m − r) + m−r+1 such that 2 hfred i = hf i. Proof : In order to simplify notations and without loss of generality we suppose M = In and ι = {1, . . . , m − r}. We substitute Yι = Im−r in A(x)Y (y), and we denote by gi,j the (i, j)−th entry of the resulting matrix. We denote by fred the following system: fred = (gi,j for i ≥ j, Yι − Im−r ) .

10

We claim that, for 1 ≤ i 6= j ≤ m − r, gi,j ≡ gj,i mod hgk,` , k > m − ri, which implies that fred verifies the statement. Let ai,j denote the (i, j)−th entry of A(x). Let i < j and write m m X X gi,j = ai,j + ai,` y`,j and gj,i = aj,i + aj,` y`,i . `=m−r+1 P gi,j − gj,i = m `=m−r+1

`=m−r+1

We deduce that ai,` y`,j − aj,` y`,i since A is symmetric. Also, modulo the ideal hgk,` , k > m − ri, and for ` ≥ m − r + 1, one can explicit ai,` and aj,` , by using polynomial relations g`,i = 0 and g`,j = 0, as follows: ! m m m X X X gi,j − gj,i ≡ − a`,t yt,i y`,j + a`,t yt,j y`,i ≡ ≡

`=m−r+1 m X

t=m−r+1

t=m−r+1

a`,t (−yt,i y`,j + yt,j y`,i ) ≡ 0

mod hgk,` , k > m − ri .

`,t=m−r+1

The previous congruence concludes the proof.



We prove below in Proposition 7 and in Corollary 11 that, up to genericity assumptions, the ideal hf i = hfred i is radical and that ]fred matches the codimension of Vr . In the next example, we explicitly write down the redundancies shown in Lemma 5 for a simple case. Example 6 We consider a 3 × 3 symmetric matrix of unknowns, and the kernel corresponding to the configuration {1, 2} ⊂ {1, 2, 3}. Let      f11 f12 x1 x2 x 3 1 0  f21 f22  =  x2 x4 x5   0 1 . f31 f32 x3 x5 x6 y31 y32 We consider the classes of polynomials f12 , f21 modulo hf31 , f32 i, deducing the following linear relation: f12 − f21 = y32 x3 − y31 x5 ≡ y31 x6 y32 − y32 x6 y31 = 0. Lagrange systems  Let f (A, ι) be the polynomial system defining Vr (A, ι). We set c = m(m − r) + m−r+1 2 and e = m−r , so that Vr is defined by c = ]fred polynomial equations, and e = ]f − c 2 is the number of redundancies eliminated by Lemma 5. We define, for M ∈ GLn (C), the polynomial system ` = `(A ◦ M, ι), given by the coordinates of the map ` : Cn × Cm(m−r) × Cc+e −→ (x, y, z) 7−→

Cn+m(m−r)+c+e  f (A ◦ M, ι), z T Df (A ◦ M, ι) − (eT1 , 0) ,

where e1 ∈ Qn is the first column of the identity matrix In . We also define Z(A ◦ M, ι) = Z(`(A ◦ M, ι)). When Vr (A ◦ M, ι) is smooth and equidimensional, Z(A ◦ M, ι) encodes the critical points of the restriction of Π1 (x, y) = x1 to Vr (A ◦ M, ι). Output representation The output of the algorithm is a rational parametrization (q0 , . . . , qn+1 ) ⊂ Z[t] such that the finite set defined in (1) contains at least one point on the spectrahedron S . 11

3.2

Real root finding for symmetric low rank loci

We describe the main subroutine LowRankSym, which is a variant for symmetric pencils of the algorithms in [34, 35, 36]. Its output is a finite set meeting each connected component of Dr ∩ Rn . It takes advantage of the particular properties of the incidence varieties over a symmetric low rank locus, as highlighted by Lemma 5. Properties We define the following properties for a given A ∈ Sn+1 m (Q): Property P1 . We say that A satisfies P1 if, for all ι ⊂ {1, . . . , m}, with ]ι = m − r, the incidence variety Vr (A, ι) is either empty or smooth and equidimensional. Property P2 . We say that A satisfies P2 if, for all r, Dr has the expected dimension n − m−r+1 . Property P2 holds generically in Sn+1 m (Q), as shown by Lemma 4. 2 We also define the following property for a polynomial system f ⊂ Q[x] and a Zariski open set O ⊂ Cn : Property Q. Suppose that f ⊂ Q[x] generates a radical ideal and that it defines an algebraic set of codimension c, and let O ⊂ Cn be a Zariski open set. We say that f satisfies Q in O, if the rank of Df is c in Z(hf i) ∩ O. Formal description of LowRankSym The formal description of our algorithm is given next. It consists of a main algorithm which checks the genericity hypotheses, and of a recursive sub-algorithm called LowRankSymRec.

12

LowRankSym Input: A ∈ Sn+1 m (Q), encoded by the m(m + 1)(n + 1)/2 entries of A0 , A1 , . . . , An , and an integer 1 ≤ r ≤ m − 1; Output: Either the empty list [ ], if and only if Dr ∩ Rn = ∅, or an error message stating that the genericity assumptions are not satisfied, or a rational parametrization q = (q0 , . . . , qn+1 ) ⊂ Z[t], such that for every connected component C ⊂ Dr ∩ Rn , with C ∩ Dr−1 = ∅, there exists t∗ ∈ Z(qn+1 ) ∩ R with (q1 (t∗ )/q0 (t∗ ), . . . , qn (t∗ )/q0 (t∗ )) ∈ C. Procedure LowRankSym(A, r)  1. if n < m−r+1 then 2 • if dim Dr = −1 then return [ ], else return(“the input is not generic”); 2. for ι ⊂ {1, . . . , m} with ]ι = m − r do • if IsReg((A, ι)) = false then return(“the input is not generic”); 3. return(LowRankSymRec(A, r)). Procedure LowRankSymRec(A, r) 1. choose M ∈ GLn (Q); 2. q ← [ ]; for ι ⊂ {1, . . . , m} with ]ι = m − r do • qι ← Image(Project(RatPar(`(A ◦ M, ι))), M −1 ); • q ← Union(q, qι ); 3. choose t ∈ Q; A ← (A0 + tA1 , A2 , . . . , An ); 4. q 0 ← Lift(LowRankSymRec(A, r), t); 5. return(Union(q, q 0 )). The routines appearing in the previous algorithm are described next: • IsReg. Input: A ∈ Sn+1 m (Q), ι ⊂ {1, . . . , m}; Output: true if Vr (A, ι) is empty or smooth and equidimensional of codimension m(m − r) + m−r+1 , false otherwise. 2 • Project. Input: A rational parametrization of `(A ◦ M, ι) ⊂ Q[x, y, z]; Output: an error message if the projection of Z(A ◦ M, ι) ∩ {(x, y, z) : rank A(M x) = r} on the x−space is not finite; otherwise a rational parametrization of this projection. 13

• RatPar. Input: `(A ◦ M, ι) ⊂ Q[x, y, z]; Output: a rational parametrization of `(A ◦ M, ι). • Image. Input: a rational parametrization of a set Z ⊂ Q[x1 , . . . , xN ] and a matrix M ∈ GLN (Q); Output: a rational parametrization of M −1 Z = {x ∈ CN : M x ∈ Z}. • Union. Input: two rational parametrizations encoding Z1 , Z2 ⊂ Q[x1 , . . . , xN ]; Output: a rational parametrization of Z1 ∪ Z2 . • Lift. Input: a rational parametrization of a set Z ⊂ Q[x1 , . . . , xN ], and t ∈ C; Output: a rational parametrization of {(t, x) : x ∈ Z}.

3.3

Main algorithm: description

The input of SolveLMI is a linear matrix A ∈ Sn+1 m (Q), and the algorithm makes use of algorithm LowRankSym described previously, as a subroutine. The formal description is the following.

SolveLMI Input: A ∈ Sn+1 m (Q), encoded by the m(m + 1)(n + 1)/2 entries of A0 , A1 , . . . , An ; Output: Either the empty list [ ], if and only if {x ∈ Rn : A(x)  0} is empty; or an error message stating that the genericity assumptions are not satisfied, or, otherwise, either a vector x∗ = (x∗1 , . . . , x∗n ) such that A(x∗ ) = 0, or a rational parametrization q = (q0 , . . . , qn+1 ) ⊂ Z[t], such that there exists t∗ ∈ Z(qn+1 )∩R with A(q1 (t∗ )/q0 (t∗ ), . . . , qn (t∗ )/q0 (t∗ ))  0. Procedure SolveLMI(A) 1. x∗ ← SolveLinear(A); if x∗ 6= [ ] then return(x∗ ); 2. for r from 1 to m − 1 do: • q ← LowRankSym(A, r); • if q = “the input is not generic” then return(q); • if q 6= [ ] then b ← CheckLMI(A, q); • if b = true then return(q); 3. return([ ], “the spectrahedron is empty”).

The different subroutines of SolveLMI are described next: 14

• SolveLinear. Input: A ∈ Sn+1 m (Q); Output the empty list if A(x) = 0 has no solution, otherwise x∗ such that A(x∗ ) = 0; • CheckLMI. Input: A ∈ Sn+1 m (Q) and a rational parametrization q ⊂ Z[t]; Output: ∗ ∗ true if A(q1 (t )/q0 (t ), . . . , qn (t∗ )/q0 (t∗ ))  0 is satisfied for some t∗ ∈ Z(qn+1 ) ∩ R, false otherwise.

3.4

Main algorithm: correctness

We prove in Theorem 10 that SolveLMI returns a correct output if genericity properties on input data and on random parameters chosen during its execution are satisfied; the proof relies on some preliminary results that are described before. The proofs of these intermediate results share some techniques with [34, 35, 36] and are given in Section 4. Intermediate results The first result is a regularity theorem for the incidence varieties Vr (A, ι). We focus on property P1 for the input matrix A (cf. Section 3.2). Proposition 7 Let m, n, r ∈ N, with 0 ≤ r ≤ m − 1. 1. There exists a non-empty Zariski-open set A ⊂ Sn+1 m (C) such that if A ∈ A ∩ n+1 Sm (Q), then A satisfies P1 ; 2. if A satisfies P1 , there exists a non-empty Zariski open set T ⊂ C such that if t ∈ T ∩ Q, then (A0 + tA1 , A2 , . . . , An ) satisfies P1 . Next, we prove that the projection of Z(A ◦ M, ι) ∩ {(x, y, z) : rank A(M x) = r} over the x−space is finite and that this set meets the critical points of the restriction of the map Π1 : (x, y) → x1 to Vr (A, ι). Proposition 8 Let A ∈ Sn+1 m (Q) satisfy P1 . Then there exists a non-empty Zariski open set M1 ⊂ GLn (C) such that, if M ∈ M1 ∩Mn,n (Q), for all ι ⊂ {1, . . . , m}, with ]ι = m−r, the following holds: 1. The system `(A ◦ M, ι) satisfies Q in {(x, y, z) : rank A(M x) = r}; 2. the projection of Z(A◦M, ι)∩{(x, y, z) : rank A(M x) = r} on the x−space is empty or finite; 3. the projection of Z(A ◦ M, ι) ∩ {(x, y, z) : rank A(M x) = r} on (x, y) contains the set of critical points of the restriction of Π1 : (x, y) → x1 to Vr (A ◦ M, ι) ∩ {(x, y) : rank A(M x) = r}.

15

Finally, we show, after a generic linear change of variables x, closure properties of the projection maps πi (x) = (x1 , . . . , xi ) restricted to Dr . Also, in order to compute sample points on the connected components of Dr ∩ Rn not meeting Dr−1 , the next proposition shows that to do that it is sufficient to compute critical points on the incidence variety Vr . Proposition 9 Let A ∈ Sn+1 m (Q) satisfy P1 , and let d = dim Dr . There exists a nonempty Zariski open set M2 ⊂ GLn (C) such that if M ∈ M2 ∩ Mn,n (Q), for any connected component C ⊂ Dr ∩ Rn , the following holds: 1. for i = 1, . . . , d, πi (M −1 C) is closed; further, for t ∈ R lying on the boundary of π1 (M −1 C), then π1−1 (t) ∩ M −1 C is finite; 2. let t lie on the boundary of π1 (M −1 C): for x ∈ π1−1 (t)∩M −1 C, such that rank A(M x) = r, there exists ι ⊂ {1, . . . , m}, with ]ι = m − r, and (x, y) ∈ Vr (A ◦ M, ι), such that Π1 (x, y) = t. Theorem of correctness n+1 Let A ∈ Sm,m (Q) be the input of SolveLMI. We say that hypothesis H holds if:

• A and all parameters generated by SolveLMI belong to the Zariski open sets defined in Proposition 7, 8 and 9, for all recursive steps of LowRankSym; • A satisfies Property P2 . We can now state the correctness theorem for SolveLMI. Theorem 10 (Correctness of SolveLMI) Suppose that H holds. Let S = {x ∈ Rn : A(x)  0} be the spectrahedron associated to A. Then two alternatives hold: 1. S = ∅: hence the output of SolveLMI with input A is the empty list; 2. S 6= ∅: hence the output of SolveLMI with input A is either a vector x∗ such that A(x∗ ) = 0, if it exists; or a rational parametrization q = (q0 , . . . , qn+1 ) ⊂ Z[t] such that there exists t∗ ∈ Z(qn+1 ) ∩ R with: • A(q1 (t∗ )/q0 (t∗ ), . . . , qn (t∗ )/q0 (t∗ ))  0 and • rank A(q1 (t∗ )/q0 (t∗ ), . . . , qn (t∗ )/q0 (t∗ )) = r(A) (cf. Notation 1). Proof : Suppose A(x) = 0 has a solution. Hence, at Step 1 of SolveLMI, SolveLinear with input A returns a vector x∗ such that A(x∗ ) = 0. We deduce that x∗ ∈ S 6= ∅ and that the rank of A attains its minimum on S at x∗ . We deduce that, if A(x) = 0 has at least one solution, the algorithm returns a correct output. Suppose now that either S is empty, or r(A) ≥ 1. We claim that LowRankSym is correct, in the following sense: with input (A, r), with A satisfying P1 , the output is a rational 16

parametrization whose solutions meet each connected component C of Dr ∩Rn such that C ∩ Dr−1 = ∅. We assume for the moment this claim, and consider two possible alternatives: 1. S = ∅. Consequently, CheckLMI outputs false at each iteration of Step 2 in SolveLMI. Thus the output of SolveLMI is the empty list, and correctness follows. 2. S 6= ∅. Denote by C a connected component of Dr(A) ∩ Rn such that C ∩ S 6= ∅. By Theorem 2, we deduce that C ⊂ S , and that C ∩ Dr(A)−1 = ∅. Let q be the output of LowRankSym at Step 2 of SolveLMI. By our claim, q defines a finite set whose solutions meet C, hence S . Consequently, CheckLMI returns true at Step 2, and hence the algorithm stops returning the correct output q. We end the proof by showing that LowRankSym is correct. This is straightforwardly implied by the correctness of the recursive subroutine LowRankSymRec, which is proved below by using induction on the number of variables n.  For n < m−r+1 , since H holds, then A satisfies Pr . Hence Dr is empty, and LowRankSym 2 returns the correct answer [ ] (the empty list).  Let n ≥ m−r+1 , and let (A, r) be the input. The induction hypothesis implies that for 2 n ˜ r) returns a rational any A˜ ∈ Sm (Q) satisfying P1 , then LowRankSymRec with input (A, ˜ ˜ r ∩Rn−1 such that parametrization of a finite set meeting each connected component C ⊂ D ˜ r−1 = ∅, with D ˜ r = {x ∈ Rn−1 : rank A(x) ˜ C˜ ∩ D ≤ r}. Let C ⊂ Dr ∩Rn be a connected component with C ∩ Dr−1 = ∅, and let M be the matrix chosen at Step 1. Hence, since H holds, by Proposition 9 the set π1 (M −1 C) is closed in R. There are two possible scenarios. First case. Suppose that π1 (M −1 C) = R, let t ∈ Q be the rational number chosen at Step 3 of LowRankSymRec, and let A˜ = (A0 + tA1 , A2 , . . . , An ) ∈ Snm (Q). We deduce that π1−1 (t) ∩ M −1 C = 6 ∅ is the union of some connected components of the algebraic n−1 ˜ ˜ ˜ r−1 . Also, since A satisfies P1 , set Dr = {x ∈ R : rank A(x) ≤ r} not meeting D so does A ◦ M ; by Proposition 7, then A˜ satisfies P1 . By the induction assumption, ˜ r) returns at least one point in each connected component LowRankSymRec with input (A, n−1 ˜ r ∩R ˜ r−1 , hence one point in C by applying the subroutine Lift at C˜ ⊂ D not meeting D Step 4. Correctness follows. Second case. Otherwise, π1 (M −1 C) 6= R and, since it is a closed set, its boundary is non-empty. Let t belong to the boundary of π1 (M −1 C), and suppose w.l.o.g. that π1 (M −1 C) ⊂ [t, +∞). Hence t is the minimum of the restriction of the map π1 to M −1 C. By Proposition 9, the set π1−1 (t) ∩ M −1 C is non-empty and finite, and for all x ∈ π1−1 (t) ∩ M −1 C, rank A(M x) = r (indeed, for x ∈ M −1 C, then M x ∈ C and hence Mx ∈ / Dr−1 ∩ Rn ). Fix x ∈ π1−1 (t) ∩ M −1 C. By Proposition 9, there exists ι and y ∈ Cm(m−r) such that (x, y) ∈ Vr (A ◦ M, ι). Also, by Proposition 7, the set Vr (A ◦ M, ι) is smooth and equidimensional. One deduces that (x, y) is a critical point of the restriction of Π1 : (x, y) → x1 to Vr (A ◦ M, ι) and that there exists z such that (x, y, z) ∈ Z(A ◦ M, ι). Hence, at Step 2, the routine LowRankSymRec outputs a rational parametrization qι , among whose solutions the vector x lies. 

17

4

Proof of intermediate results

4.1

Proof of Proposition 7

We prove Assertion 1 and 2 separately. Proof of Assertion 1: Suppose w.l.o.g. that M = In . For ι ⊂ {1, . . . , m}, with ]ι = m − r, let fred ⊂ Q[x, y] be the system defined in Lemma 5. We prove that there n+1 exists a non-empty Zariski open set Aι ⊂ Sn+1 m (C) such that, if A ∈ Aι ∩ Sm (Q), fred generates a radical ideal  and Z(fred ) is empty or equidimensional, of codimension m−r+1 ]fred = m(m − r) + . We deduce that, for A ∈ Aι , A satisfies P1 , and we conclude 2 by defining A = ∩ι Aι (non-empty and Zariski open). Suppose w.l.o.g. that ι = {1, . . . , m − r}. We consider the map m−r+1 2

m(m−r)+( ϕ : Cn+m(m−r) × Sn+1 m (C) −→ C (x, y, A) 7−→ fred

)

m−r+1 2

n+m(m−r) and, for a fixed A ∈ Sn+1 → Cm(m−r)+( m (C), its section map ϕA : C by ϕA (x, y) = ϕ(x, y, A). Remark that, for any A, Z(ϕA ) = Vr (A, ι).

) defined

Suppose ϕ−1 (0) = ∅: this implies that, for all A ∈ Sn+1 m (C), Z(fred ) = Vr (A, ι) = ∅, that is A satisfies P1 for A ∈ Aι = Sn+1 (C). m If ϕ−1 (0) 6= ∅, we prove below that 0 is a regular value of ϕ. We conclude that by Thom’s Weak Transversality Theorem [60, Section 4.2] there exists a non-empty and Zariski open n+1 set Aι ⊂ Sn+1 m (C) such that if A ∈ Aι ∩ Sm (Q), 0 is a regular value of ϕA . Hence, by applying the Jacobian criterion (cf. [16, Theorem 16.19]) to the polynomial system fred , we deduce that for A ∈ Aι ∩ Sn+1 m (Q), Vr (A, ι) is smooth and equidimensional of codimension ]fred . Let Dϕ be the Jacobian matrix of ϕ: it contains the derivatives of polynomials in fred with respect to variables x, y, A. We denote by a`,i,j the variable encoding the (i, j)−th entry of the matrix A` , ` = 0, . . . , n. We isolate the columns of Dϕ corresponding to: • the derivatives with respect to variables {a0,i,j : i ≤ m − r or j ≤ m − r}; • the derivatives with respect to variables yi,j such that i ∈ ι. Let (x, y, A) ∈ ϕ−1 (0), and consider the evaluation of Dϕ at (x, y, A). The above columns contain the following non-singular blocks: • the derivatives w.r.t. {a0,i,j : i ≤ m − r or j ≤ m − r} of the entries of A(x)Y (y) after the substitution Yι ← Im−r , that is I(m−r)(m+r+1)/2 ; • the derivatives w.r.t. {yi,j : i ∈ ι} of polynomials in Yι − Im−r , that is I(m−r)2 . Hence, the above columns define a maximal non-singular sub-matrix of Dϕ at (x, y, A), of size m(m − r) + m−r+1 = ]fred (indeed, remark that the entries of Yι − Im−r do not 2 18

depend on variables a0,i,j ). Since (x, y, A) ∈ ϕ−1 (0) is arbitrary, we deduce that 0 is a regular value of ϕ, and we conclude.  Proof of Assertion 2: Fix ι ⊂ {1, . . . , m} with ]ι = m − r. Since A satisfies P1 , Vr (A, ι) is either empty or smooth and equidimensional of codimension m(m−r)+ m−r+1 . 2 Suppose first that Vr = ∅. Hence for all t ∈ C, Vr ∩ {x1 − t = 0} = ∅, and we conclude by defining T = C. Otherwise, consider the restriction of the projection map Π1 : (x, y) → x1 to Vr (A, ι). By Sard’s Lemma [60, Section 4.2], the set of critical values of the restriction of π1 to Vr (A, ι) is included in a finite subset H ⊂ C. We deduce that, for t ∈ T = C \ H, then (A0 + tA1 , A2 , . . . , An ) satisfies P1 .  Corollary 11 Let A ⊂ Sn+1 m (Q) be as in Proposition 7, and let A ∈ A . Then for every ι ⊂ {1, . . . , m} with ]ι = m−r, the ideal hfred i = hf i is radical, and Vr (A, ι) is a complete intersection of codimension ]fred . Proof : We recall from the proof of Assertion 1 of Theorem 7 that,  for A ∈ A , the rank of the Jacobian matrix of fred is ]fred = m(m − r) + m−r+1 at every point of 2 Vr (A, ι). By the Jacobian criterion [16, Theorem 16.19], the ideal hfred i is radical and the algebraic set Z(fred ) = Vr (A, ι) is smooth and equidimensional of codimension ]fred . Hence I(Vr (A, ι)) = hfred i can be generated by a number of polynomials equal to the codimension of Vr (A, ι), and we conclude. 

4.2

Proof of Proposition 8

Local equations of Vr (A, ι) Suppose A is a (not necessarily symmetric) linear matrix. Let us give a local description of the algebraic sets Dr and Vr (cf. also [34, Section 5]). Consider first the locally closed set Dr \ Dr−1 = {x ∈ Cn : rank A(x) = r}. This is given by the union of sets Dr ∩ {x ∈ Cn : det N (x) 6= 0} where N runs over all r × r sub-matrices of A(x). Fix ι ⊂ {1, . . . , m} with ]ι = m − r. Let N be the upper left r × r sub-matrix of A(x), and consider the corresponding block division of A:   N Q A= (3) PT R with P, Q ∈ Mr,m−r (Q) and R ∈ Mm−r,m−r (Q). Let Q[x, y]det N be the local ring obtained by localizing Q[x, y] at hdet N i. Let Y (1) (resp. Y (2) ) be the matrix obtained by isolating the first r (resp. the last m − r) rows of Y (y). Hence, the local equations of Vr in {(x, y) : det N (x) 6= 0} are given by: Y (1) + N −1 QY (2) = 0,

Σ(N )Y (2) = 0,

Yι − Im−r = 0,

(4)

where Σ(N ) = R − P T N −1 Q is the Schur complement of N in A. This follows from the following straightforward equivalence holding in the local ring Q[x, y]det N (cf. also [34, Lemma 13]):    −1   Ir 0 N 0 N Q A(x)Y (y) = 0 iff Y (y) = 0. −P T Im−r 0 Im−r PT R 19

Intermediate lemma Let w ∈ Cn be a non-zero vector, and consider the projection map induced by w: Πw : (x1 , . . . , xn , y) 7→ w1 x1 + · · · + wn xn . For A ∈ A (given by Proposition 7), for all ι as above, the critical points of the restriction of Πw to Vr (A, ι) are encoded by the polynomial system (f, g, h) where     Df Dx f D y f T T f = f (A, ι), (g, h) = z =z , (5) DΠw wT 0 and z = (z1 , . . . , zc+e , 1) is a vector of Lagrange multipliers. Indeed, equations induced by (g, h) imply that the vector w is normal to the tangent space of Vr at (x, y). We prove an intermediate lemma towards Proposition 8. Lemma 12 Let A ∈ Sn+1 m (Q) satisfy P1 . Then there exists a non-empty Zariski open set W ⊂ Cn such that, if w ∈ W ∩ Qn , for all ι ⊂ {1, . . . , m}, with ]ι = m − r, the following holds: 1. the system (f, g, h) in (5) satisfies Q in {(x, y, z) : rank A(x) = r}; 2. the projection of Z(f, g, h) ∩ {(x, y, z) : rank A(x) = r} on the x−space is empty or finite; 3. the projection of Z(f, g, h) ∩ {(x, y, z) : rank A(x) = r} on (x, y) contains the set of critical points of the restriction of Πw to Vr ∩ {(x, y) : rank A(x) = r}. Proof of Assertion 1: The strategy relies on applying Thom Weak Transversality Theorem and the Jacobian criterion, as in the proof of Proposition 7. The similar passages will be only sketched. We claim (and prove below) that, given a r × r sub-matrix N of A, there exists a non-empty Zariski open set WN ⊂ Cn such that, for w ∈ WN , T (f, g, h) satisfies Q in {(x, y, z) : det N 6= 0}. We deduce Assertion 1 by defining W = N WN , where N runs over all r × r sub-matrices of A(x). (1)

(2)

Let Uι ∈ C(m−r)×m be the boolean matrix such that Uι Y (y) = Yι , and let Uι = (Uι | Uι ) (1) (2) be the subdivision with Uι ∈ C(m−r)×r and Uι ∈ C(m−r)×(m−r) . The third equation in (4) equals Uι Y (y) − Im−r = 0. From (4) we deduce the equality Im−r = Uι(1) Y (1) + Uι(2) Y (2) = (Uι(2) − Uι(1) N −1 Q)Y (2) (2)

(1)

and hence that both Y (2) and Uι −Uι N −1 P are non-singular in Q[x, y]det N . We deduce that the above local equations of Vr are equivalent to Y (1) + N −1 QY (2) = 0,

Y (2) − (Uι(2) − Uι(1) N −1 P )−1 = 0 in Q[x, y]det N . We collect the above equations in a system f˜, of length c + e. Hence, the Jacobian matrix of f˜ is   Dx [Σ(N )]i,j 0(m−r)2 ×m(m−r) . Ir(m−r) ? Df˜ =  ? 0 I(m−r)2 Σ(N ) = 0,

20

Since A satisfies P1 , the rank of Df˜ is constant and equal to c if evaluated at (x, y) ∈ Z(f˜) = Vr (A, ι) ∩ {(x, y) : det N 6= 0}. Similarly to (5), we define   ˜ D f T ˜ =z (˜ g , h) wT 0 ˜ i = 0 implies that z(m−r)2 +i = 0, with z = (z1 , . . . , zc+e , 1). The polynomial relations h for i = 1, . . . , m(m − r), and hence they can be eliminated, together with the variables ˜ z(m−r)2 +i , i = 1, . . . , m(m − r). Hence, one can consider the equivalent equations (f˜, g˜, h) where the last m(m − r) variables z do not appear in g˜. ˜ Let us define the map ϕ : Cn+c+e+m(m−r) × Cn → Cn+c+e+m(m−r) , ϕ(x, y, z, w) = (f˜, g˜, h), n and for w ∈ C , its section map ϕw : (x, y, z) 7→ ϕ(x, y, z, w). If ϕ−1 (0) = ∅, we define WN = Cn and conclude. Otherwise, let (x, y, z, w) ∈ ϕ−1 (0). Remark that polynomials in f˜ just depend on (x, y), hence their contribution in Dϕ(x, y, z, w) is the block Df˜, whose rank is c, since (x, y) ∈ Vr . Hence, we deduce that the rowrank of Dϕ at (x, y, z, w) is at most n + c + m(m − r). Further, by isolating the columns corresponding to the derivatives with respect to x, y, to w1 , . . . , wn , and to z(m−r)2 +i , i = 1, . . . , m(m − r), one obtains a (n + c + e + m(m − r)) × (2n + 2m(m − r)) sub-matrix of Dϕ of rank n + c + m(m − r).  Proof of Assertion 2: From Assertion 1 we deduce that the locally closed set E = Z(f, g, h)∩{(x, y, z) : rank A(x) = r} is empty or e−equidimensional. If it is empty, we are done. Suppose that it is e−equidimensional. Consider the projection map πx (x, y, z) = x, and its restriction to E. Let x∗ ∈ πx (E). Then rank A(x∗ ) = r and there exists a unique y ∈ Cm(m−r) such that f (x∗ , y) = 0. Hence the fiber πx−1 (x∗ ) is isomorphic to the linear space {(z1 , . . . , zc+e ) : (z1 , . . . , zc+e )Df = (wT , 0)}. Since the rank of Df is c, one deduces that πx−1 (x∗ ) is a linear space of dimension e, and by the Theorem on the Dimension of Fibers [63, Sect. 6.3, Theorem 7] we deduce that πx (E) has dimension 0.  Proof of Assertion 3: Since Vr ∩ {(x, y) : rank A(x) = r} is smooth and equidimensional, by [60, Lemma 3.2.1], for w 6= 0, the set crit (Πw , Vr ) coincides with the set of points (x, y) ∈ Vr such that the matrix   Df D(f, Πw ) = DΠw has a rank ≤ c. In particular there exists z = (z1 , . . . , zc+e , zc+e+1 ) 6= 0, such that z T D(f, Πw ) = 0. One can exclude that zc+e+1 = 0, since this implies that Df has a non-zero vector in the left kernel, which contradicts the fact that A satisfies P1 . Hence without loss of generality we deduce that zc+e+1 = 1, and we conclude.  Proof of the proposition We can finally deduce the proof of Proposition 8. Proof of Proposition 8: Define M1 as the set of matrices M ∈ GLn (C) such that the first row of M −1 is contained in W (defined in Lemma 12). The proof of all assertions 21

follows from Lemma 12 since, for M ∈ M1 , one gets      Df (A, ι) ◦ M M 0 Df (A ◦ M, ι) = , wT 0 · · · 0 0 Im(m−r) eT1 0 · · · 0

(6)

where wT is the first row of M −1 . Indeed, for z = (z1 , . . . , zc+e ), we deduce from the previous relation that the set of solutions to the equations f (A, ι) = 0,

z T Df (A, ι) = (wT , 0)

(7)

z T Df (A ◦ M, ι) = (eT1 , 0)

(8)

is the image of the set of solutions of f (A ◦ M, ι) = 0, by the linear map   −1   x M 0 0 x  y  7→  0 Im(m−r) 0   y  . z 0 0 Ic+e z 

This last fact is straightforward since from (6) we deduce that system (8) is equivalent to f (A ◦ M, ι) = 0, z T (Df (A, ι) ◦ M ) = (wT , 0). Hence the three assertions of Proposition 8 are straightforwardly deduced by those of Lemma 12. 

4.3

Proof of Proposition 9

For the proof of Assertion 1 of Proposition 9, we need to recall some notation from [34, Sec. 5]. Let Z ⊂ Cn be an algebraic set of dimension d. Its equidimensional component of dimension p, for 0 ≤ p ≤ d, is Ωp (Z). We define S (Z) = Ω0 (Z)∪· · ·∪Ωd−1 (Z)∪singΩd Z, where we recall that sing V denotes the singular locus of an algebraic set V, and C (πi , Z) = Ω0 (Z) ∪ · · · ∪ Ωi−1 (Z) ∪

d [

crit (πi , reg Ωr Z),

r=i

Here reg V denotes V \ sing V, πi : x 7→ (x1 , . . . , xi ) and crit (g, V) the set of critical points of the restriction of a map g to V. For M ∈ GLn (C) we recursively define • Od (M −1 Z) = M −1 Z; • Oi (M −1 Z) = S (Oi+1 (M −1 Z)) ∪ C (πi+1 , Oi+1 (M −1 Z)) ∪ C (πi+1 , M −1 Z) for i = 0, . . . , d − 1. In [34, Prop. 17] we proved that when M is generic in GLn (C) (that is, it lies out of a proper algebraic set) the algebraic sets Oi (M −1 Z) have dimension at most i and are in Noether position with respect to x1 , . . . , xi (cf. [63, 16] for a background in Noether position). We used this fact in [34, Prop. 18] to prove closure properties of the restriction of maps πi , i = 1, . . . , d, to the connected components of Z ∩ Rn . 22

Proof of Assertion 1: We denote by M2 ⊂ GLn (C) the non-empty Zariski open set defined in [34, Prop. 17], for the algebraic set Dr . Hence, for M ∈ M2 , we deduce by [34, Prop. 18] that for i = 1, . . . , d, and for any connected component C ⊂ Dr ∩ Rn , the boundary of πi (M −1 C) is contained in πi (Oi−1 (M −1 Dr ) ∩ M −1 C) ⊂ πi (M −1 C), and hence that πi (M −1 C) is closed. Moreover, let C ⊂ Dr ∩ Rn be a connected component and let t ∈ R be in the boundary of π1 (M −1 C). Then [34, Lemma 19] implies that π1−1 (t) ∩ M −1 C is finite.  Proof of Assertion 2: Let M ∈ M2 . Consider the open set O = {(x, y) ∈ Cn+m(m−r) : rank A(M x) = r, rank Y (y) = m − r}. Let Πx : Cn+m(m−r) → Cn , Πx (x, y) = x. Then Πx (O) is the locally closed set M −1 (Dr \ Dr−1 ) = {x ∈ Cn : rank A(M x) = r}. We consider the restriction of polynomial equations A(M x)Y (y) = 0 to O. By definition of O, we can split the locally closed set O ∩ Z(A(M x)Y (y)) into the union   [ O ∩ Z(A(M x)Y (y)) = Oι ∩ Z(A(M x)Y (y)) , ι ⊂ {1, . . . , m} ]ι = m − r where Oι = {(x, y) : det Yι 6= 0}. Let C be a connected component of Dr ∩ Rn . Let t lie in the frontier of π1 (M −1 C), and x ∈ π1−1 (t) ∩ M −1 C with rank A(M x) = r. Hence there exists ι ⊂ {1, . . . , m} such that x lies in the projection of Vr (A ◦ M, ι) on the x−space. Hence there exists y such that (x, y) ∈ Vr (A ◦ M, ι) and such that π1 (x, y) = t. 

5

Complexity analysis

Our next goal is to estimate the arithmetic complexity of algorithm SolveLMI, that is the number of arithmetic operations performed over Q. This will essentially rely on the complexities of state-of-the-art algorithms computing rational parametrizations.

5.1

Output degree estimates

We start by computing Multilinear B´ezout bounds (cf. [60, Ch. 11]) on the output degree. Proposition 13 Let A ∈ Sn+1 be the input of SolveLMI, and 0 ≤ r ≤ m − 1. Let m pr = (m − r)(m + r + 1)/2. If H holds, for all ι ⊂ {1, . . . , m}, with ]ι = m − r, the degree of the parametrization qι computed at Step 2 of LowRankSymRec is at most   X  pr  n−1 r(m − r) θ(m, n, r) = , n−k k + pr − 1 − r(m − r) k k∈G m,n,r

with Gm,n,r = {k : max{0, n − pr } ≤ k ≤ min{n − 3 m, n, r, θ(m, n, r) is bounded above by prn+n . 23

m−r+1 2



, r(m − r)}}. Moreover, for all

Proof : We can simplify the system f = f (A, ι) to a system of pr bilinear equations with respect to variables x = (x1 , . . . , xn ) and y = (ym−r+1,1 , . . . , ym,m−r ). Indeed, by Lemma 5, Vr (A, ι) is defined by Yι − Im−r = 0 and by m(m − r) − e = pr entries of A(x)Y (y),  where e = m−r . Hence we can eliminate equations Yι − Im−r = 0 and the corresponding 2 variables yi,j . Consequently, the Lagrange system can be also simplified, by admitting only pr Lagrange multipliers z. We can also eliminate the first Lagrange multiplier z1 (since z 6= 0, one can assume z1 = 1) and impose a rank defect on the truncated Jacobian matrix obtained by Df by eliminating the first column (that containing the derivatives with respect to x1 ). r(m−r)

The bound θ(m, n, r), by [60, Ch. 11], equals the coefficient of snx sy spzr −1 in (sx + n−1 r(m−r) pr . This can be easily obtained by writing down such an sy ) (sy + sz ) (sx + sz ) expansion and solving the associated linear system forcing the constraints on the exponents of the monomials. The result is exactly the claimed closed formula. The estimate  pr +n 3 θ(m, n, r) ≤ n is obtained by applying the standard formula:  3 min(a,b)        X a b a b a b a+b = i1 i1 i2 i2 i3 i3 a i ,i ,i =0 1 2 3

with a = n and b = pr .



Corollary 14 With the hypotheses and notations of Proposition 13, the sum of the degrees of the  rational parametrizations computed during SolveLMI is bounded above by P m r≤r(A) r θ(m, n, r). The degree of the rational parametrization whose solutions intersect S is in 3 !  m2 +m + n 2 . O n  m Proof : Remark that the number of subsets ι ⊂ {1, . . . , m}, with ]ι = m − r is m−r =  m , and that SolveLMI stops when r reaches r(A). Hence the first part follows by applying r Proposition 13. Finally, remark that p0 ≥ p1 ≥ · · · ≥ pr ≥ · · · for all m, and hence, by Proposition 13, the degree of the rational parametrization whose solutions intersect S is 3 3 3 m2 +m +n 2 .  of the order of prn+n ≤ p0n+n = n In the column deg of Table 1 we report the degrees of the rational parametrization qι returned by LowRankSymRec at Step 2, compared with its bound θ(m, n, r) computed in Proposition 13. For this table, the input are randomly generated symmetric pencils with rational coefficients. When the algorithm does not compute critical points (that is, when the Lagrange system generates the empty set) we put deg = 0. We recall that the routine LowRankSymRec computes points in components of the real algebraic set Dr ∩ Rn not meeting the subset Dr−1 ∩ Rn , hence of the expected rank r. Moreover, we recall that LowRankSym calls recursively its subroutine LowRankSymRec, eliminating at each call the first variable. Hence, the total number of critical points computed by LowRankSym for a given expected rank r is obtained by summing up the integer in column deg for every admissible value of n. We remark here that both the degree 24

and the bound are constant and equal to 0 if n is large enough. Hence, the previous sum is constant for large values of n. Similar behaviors appear, for example, when computing the Euclidean Distance degree (EDdegree) of determinantal varieties, as in [15] or [50]. In [50, Table 1], the authors report on the EDdegree of determinantal hypersurfaces generated by linear matrices A(x) = A0 + x1 A1 + · · · + xn An : for generic weights in the distance function, and when the codimension of the vector space generated by A1 , . . . , An is small (for us, when  n is big, since matrices Ai are randomly generated, hence independent for m+1 n ≤ 2 = dim Sm (Q)) the EDdegree is constant. Similar comparisons can be done with data in [50, Example 4] and [50, Corollary 3.5]. (m, r, n) deg θ(m, n, r) (m, r, n) (3, 2, 2) 6 9 (4, 3, 9) (3, 2, 3) 4 16 (5, 2, 5) (3, 2, 4) 0 15 (5, 2, 6) (3, 2, 5) 0 6 (5, 2, 7) (3, 2, 6) 0 0 (5, 3, 3) (4, 2, 3) 10 35 (5, 3, 4) (4, 2, 4) 30 245 (5, 4, 2) (4, 2, 5) 42 896 (5, 4, 3) (4, 2, 6) 30 2100 (5, 4, 4) (4, 2, 7) 10 3340 (5, 4, 5) (4, 2, 8) 0 3619 (6, 3, 3) (4, 2, 9) 0 2576 (6, 3, 4) (4, 2, 12) 0 0 (6, 3, 5) (4, 3, 3) 16 52 (6, 3, 6) (4, 3, 4) 8 95 (6, 4, 2) (4, 3, 7) 0 20 (6, 4, 3) (4, 3, 8) 0 0 (6, 5, 3)

deg θ(m, n, r) 0 0 0 0 35 924 140 10296 20 84 90 882 20 30 40 120 40 325 16 606 0 0 0 0 0 0 112 5005 0 0 35 165 80 230

Table 1: Degrees and bounds for rational parametrizations The values in column deg of Table 1 must also be compared with the associated algebraic degree of semidefinite programming. Given integers k, m, r with r ≤ m − 1, Nie, Ranestad, Sturmfels and von Bothmer computed in [48, 24] formulas for the algebraic degree δ(k, m, r) of a generic semidefinite program associated to m×m k−variate linear matrices, with expected rank r. Since the values in column deg match exactly the corresponding values in [48, Table 2], we conclude this section with the following expected result, which is a work in progress. Conjecture 15 Let A ∈ Sn+1 m (Q) be the input of SolveLMI, and suppose that S = {x ∈ n R : A(x)  0} is not empty. Let δ(k, m, r) be the algebraic degree of a generic semidefinite program with parameters k, m, r as in [48, 24]. If H holds, then the sum of the degrees of the rational parametrizations computed during SolveLMI is r(A)   X m r r=1

min(n,pr +r(m−r))

X k=pr −r(m−r)

25

δ(k, m, r),

where pr = (m − r)(m + r + 1)/2.

5.2

The complexity of SolveLMI

Complexity of some subroutines We first provide complexity estimates for subroutines SolveLinear, CheckLMI, Project, Lift, Image and Union. Complexity of SolveLinear. This subroutine computes, if it exists, a solution of the A(x) = 0. This elimination. The complexity of solving  can be essentially performed by Gaussian m+1  m+1 linear equations in n variables is linear in and cubic in n. 2 2 Complexity of CheckLMI. This subroutine can be performed as follows. Let q ⊂ Z[t] be the rational parametrization in the input of CheckLMI. The spectrahedron S = {x ∈ Rn : A(x)  0} is the semi-algebraic set defined, e.g., by sign conditions on the coefficients of the characteristic polynomial p(s, x) = det(A(x) + s Im ) = fm (x) + fm−1 (x)s + · · · + f1 (x)sm−1 + sm . That is, S = {x ∈ Rn : fi (x) ≥ 0, ∀ i = 1, . . . , m}. We make the substitution xi ← qi (t)/q0 (t) in A(x) and compute the coefficients of p(s, x(t)), that are rational functions of the variable t. Hence CheckLMI boils down to deciding on the sign of m univariate rational functions (that is, of 2m univariate polynomials) over the finite set defined by qn+1 (t) = 0. We deduce that the complexity of CheckLMI is polynomial in m and on the degree of qn+1 (that is, on the degree of q) see [6, Ch. 13]. Complexity of Project, Lift, Image and Union Estimates for the arithmetic complexities of these routines are given in [60, Ch. 10]. In particular, if θ = θ(m, n, r) is the bound computed in Proposition 13, and n ˜ = n + r(m − r) + pr , then: • By [60, Lemma 10.1.5], Project is performed within O˜(˜ n2 θ2 ) operations; • By [60, Lemma 10.1.6], Lift is performed within O˜(˜ nθ2 ) operations; • By [60, Lemma 10.1.1], Image is performed within O˜(˜ n2 θ + n ˜ 3 ) operations; • By [60, Lemma 10.1.3], Union is performed within O˜(˜ nθ2 ) operations. Complexity of LowRankSym and SolveLMI The complexity of LowRankSym boils essentially down to the complexity of LowRankSymRec, that is the complexity of RatPar. This is performed with the symbolic homotopy algorithm [39]: we bound its complexity in this section. We just remark that computing the dimension of Dr at Step 1 of LowRankSym and performing the control routine IsReg can be done by combining the Jacobian criterion and Gr¨obner bases computations. Our complexity analysis omits this step.

26

We recall that the simplified Lagrange system defined in the proof of Proposition 13 contains: pr = (m − r)(m + r + 1)/2 polynomials of multidegree bounded by (1, 1, 0); n−1 polynomials of multidegree bounded by (0, 1, 1); r(m−r) polynomials of multidegree bounded by (1, 0, 1). Let us denote by ` this system. We denote by ∆xy = {1, xi , yj , xi yj : i = 1, . . . , n, j = 1, . . . , r(m − r)} ∆yz = {1, yj , zk , yj zk : j = 1, . . . , r(m − r), k = 2 . . . , pr } ∆xz = {1, xi , zk , xi zk : i = 1, . . . , n, k = 2, . . . , pr } the supports of the aforementioned three groups of polynomials. Let `e ⊂ Q[x, y, z] be a polynomial system such that: • the length of `˜ equals that of `; • for i = 1, . . . , n − 1 + m2 − r2 , the support of `˜i equals that of `i ; • the solutions of `˜ are known. Remark that `e can be easily built by considering suitable products of linear forms. We build the homotopy τ ` + (1 − τ )`˜ ⊂ Q[x, y, z, τ ], (9) where τ is a new variable. The system (9) defines a curve. From [39, Proposition 6.1], if the ˜ solutions of `˜ are known, one can compute a rational parametrization of Z(t` + (1 − t)`) 2 ω+1 0 within O((˜ n N log Q + n ˜ )ee ) arithmetic operations over Q, where: n ˜ is the number of variables in `; N = pr ]∆xy + (n − 1)]∆yz + r(m − r)]∆xz ; Q = max{kqk : q ∈ ∆xy ∪ ˜ ∆yz ∪ ∆xz }; e is the number of isolated solutions of `; e0 is the degree of Z(t` + (1 − t)`); ω is the exponent of matrix multiplication. ˜ The technical lemma below gives a bound on the degree of Z(t` + (1 − t)`). Lemma 16 Let Gm,n,r and θ(m, n, r) be the set and the bound defined in Proposition ˜ Then e0 ∈ 13, and suppose that Gm,n,r 6= ∅. Let e0 be the degree of Z(t` + (1 − t)`). O ((n + pr + r(m − r)) min{n, pr } θ(m, n, r)) . ˜ Proof : Similarly to Proposition 13, we exploit the multilinear structure of t` + (1 − t)`, 0 to compute a bound on e . The system is bilinear with respect to x, y, z, τ . We recall ]x = n, ]y = r(m − r), ]z = pr − 1, ]τ = 1, with pr = (m − r)(m + r + 1)/2. By [60, Ch. 11], e0 is bounded by the sum of the coefficients of q = (sx + sy + sτ )pr (sy + sz + r(m−r)+1 pr 2 sτ )n−1 (sx + sz + sτ )r(m−r) modulo I = hsn+1 , sz , sτ i ⊂ Z[sx , sy , sz , sτ ]. We see x , sy that q = q1 + sτ (q2 + q3 + q4 ) + g with s2τ that divides g and q1 = (sx + sy )pr (sy + sz )n−1 (sx + sz )r(m−r) q2 = pr (sx + sy )pr −1 (sy + sz )n−1 (sx + sz )r(m−r) q3 = (n − 1)(sx + sy )pr (sy + sz )n−2 (sx + sz )r(m−r) q4 = r(m − r)(sx + sy )pr (sy + sz )n−1 (sx + sz )r(m−r)−1 . 27

Hence q ≡ q1 + sτ (q2 + q3 + q4 ) mod I, and the bound is given by the sum of the contributions of q1 , q2 , q3 and q4 (multiplying q2 , q3 , q4 by sτ does not change the sum of the coefficients modulo I). The contribution of q1 is the sum of the coefficients of its r(m−r)+1 pr , sz i. This has been computed in Proposition 13, and class modulo I 0 = hsn+1 x , sy coincides with θ(m, n, r). We compute the contribution of q2 . Let q2 = pr q˜2 . It is sufficient to compute the sum of the coefficients of q˜2 modulo I 0 (defined above), multiplied by pr . Since deg q˜2 = n − 2 + pr + r(m − r), and since the maximal powers admissible modulo r(m−r) I 0 are snx , sy , and spzr −1 , three configurations are possible. r(m−r)

spzr −1 in q˜2 , that is (A) The coefficient of sn−1 x sy   X  pr − 1  n−1 r(m − r) ΣA = ; n−1−k k − 1 + pr − r(m − r) k k r(m−r)−1 pr −1 sz

(B) the coefficient of snx sy ΣB =

X pr − 1 k

n−k

in q˜2 , that is n−1 k − 1 + pr − r(m − r)

  r(m − r) ; k

r(m−r) pr −2 sz

(C) the coefficient of snx sy

in q˜2 , that is   X pr − 1 n−1 r(m − r) . ΣC = n − k k − 2 + p k r − r(m − r) k

Hence we need to bound the expression pr (ΣA + ΣB + ΣC ). One can easily check that ΣA ≤ θ(m, n, r) and ΣB ≤ θ(m, n, r), while the same inequality is false for ΣC . However, we claim that ΣC ≤ (1 + min{n, pr }) θ(m, n, r) and hence that the contribution of q2 is pr (ΣA + ΣB + ΣC ) ∈ O (pr min{n, pr } θ(m, n, r)). We prove now this claim. Let χ1 = max{0, n − pr } α1 = max{0, n − pr + 1}

χ2 = min{n − pr + r(m − r), r(m − r)} α2 = min{n − pr + r(m − r) + 1, r(m − r)}

so that the sum in θ(m, n, r) runs over χ1 ≤ k ≤ χ2 and that in ΣC over α1 ≤ k ≤ α2 . Remark that χ1 ≤ α1 and χ2 ≤ α2 . Denote by ϕ(k) the k−th term in the sum defining ΣC , and by γ(k) the k−th term in the sum defining θ(m, n, r). Then for all indices k, admissible both for θ(m, n, r) and ΣC , that is for α1 ≤ k ≤ χ2 , one gets, by basic properties k−1+pr −r(m−r) of binomial coefficients, that ϕ(k) = Ψ(k) γ(k), with Ψ(k) = n−k−p . When k r +r(m−r)−1 runs over all admissible indices, Ψ(k) is non-decreasing monotone, and its maximum is Ψ(χ2 ) and is bounded by min{n, pr }. We deduce the claimed inequality ΣC ≤ (1 + min{n, pr }) θ(m, n, r), since if χ2 < α2 then χ2 = α2 − 1 and ϕ(α2 ) is bounded above by θ(m, n, r). Contributions of q3 and q4 . As for q2 , we deduce that the contribution of q3 is in O (n min{n, pr } θ(m, n, r)) and that of q4 is in O (r(m − r) min{n, pr } θ(m, n, r)).  We use this degree estimate to conclude our complexity analysis of LowRankSym. 28

Proposition 17 Let A ∈ Sn+1 m (Q) be the input of SolveLMI and 0 ≤ r ≤ m − 1. Let θ(m, n, r) be the bound defined in Proposition 13. Let pr = (m − r)(m + r + 1)/2. Then  m RatPar returns a r.p. within O˜ r (n + pr + r(m − r))7 θ(m, n, r)2 arithmetic operations over Q. Proof : Let ` be the simplified Lagrange system as in the proof of Proposition 13. We consider the bound on the degree of the homotopy curve given by Lemma 16. We deduce the claimed complexity result by applying [39, Proposition 6.1], and by recalling that there are mr many subsets of {1, . . . , m} of cardinality m − r.  We straightforwardly deduce the following complexity estimate for SolveLMI. Theorem 18 (Complexity of SolveLMI) Let A ∈ Sn+1 m (Q) be the input symmetric pencil and suppose that H holds. Then the number of arithmetic operations performed by SolveLMI are in !  m2 +m 6 X   + n m 2 O˜ n (n + (m − r)(m + 3r))7 . n r r≤m−1 Proof : From Proposition 17, we deduce that LowRankSymRec runs essentially within O˜( mr (n + pr + r(m − r))7 θ(m, n, r)2 ) arithmetic operations. The inequality θ(m, n, r) ≤  n+pr 3 is proved in Proposition 13. Moreover, there are at most n recursive calls of n LowRankSymRec in LowRankSym, and SolveLMI stops at most when r reaches m − 1. Finally, the cost of subroutines SolveLinear, CheckLMI, Project, Image and Union is negli Lift,  P gible. We deduce that the complexity of SolveLMI is in O˜ n r≤m−1 mr (n + pr + r(m − r))7 Since pr ≤ p0 =

6

m2 +m 2

and pr + r(m − r) ≤ (m − r)(m + 3r), we conclude.



Experiments

SolveLMI is implemented in a maple function, and it is part of a library called spectra (Semidefinite Programming solved Exactly with Computational Tools of Real Algebra), released in September 2015. It collects efficient and exact algorithms solving a large class of problems in real algebraic geometry and semidefinite optimization. We present in this section the results of our experiments. These have been performed on a machine with the following characteristics: Intel(R) Xeon(R) CPU [email protected] with 256 Gb of RAM. We rely on the maple implementation of the software FGb [17], for fast computation of Gr¨obner bases. To compute the rational parametrizations we use the implementation in maple of the change-of-ordering algorithm FGLM [20] and of its improved versions [21, 19].

6.1

Generic symmetric pencils

We implemented the function LowRankSym and tested the running time of the implementation with input generic symmetric linear matrices. We recall that the algorithm 29

 pr +n 6 n



SolveLMI amounts to iterating LowRankSym by increasing the expected rank r. By generic data we mean that a natural number N ∈ N large enough is fixed, and numerators and denominators of the entries of A` , ` = 0, . . . , n are uniformly generated in the interval [−N, N ]. We report in Table 2 the timings and the degrees of output rational parametrizations. (m, r, n) (3, 2, 2) (3, 2, 3) (3, 2, 4) (3, 2, 5) (3, 2, 6) (3, 2, 7) (3, 2, 8) (3, 2, 9) (4, 2, 2) (4, 2, 3) (4, 2, 4) (4, 2, 5) (4, 2, 6) (4, 2, 7) (4, 2, 8) (4, 2, 9) (4, 3, 3) (4, 3, 4) (4, 3, 5) (4, 3, 6) (4, 3, 7) (4, 3, 8)

PPC 0.2 0.3 0.9 5.1 15.5 31 109 230 0.2 0.3 2.2 12.2 ∞ ∞ ∞ ∞ 1 590 ∞ ∞ ∞ ∞

LRS 8 11 13 14 15 16 17 18 0 2 9 29 71 103 106 106 10 21 22 24 26 27

totaldeg 9 13 13 13 13 13 13 13 0 10 40 82 112 122 122 122 32 40 40 40 40 40

deg 6 4 0 0 0 0 0 0 0 10 30 42 30 10 0 0 16 8 0 0 0 0

(m, r, n) (4, 3, 9) (4, 3, 10) (4, 3, 11) (5, 2, 2) (5, 2, 3) (5, 2, 4) (5, 2, 5) (5, 2, 7) (5, 3, 2) (5, 3, 3) (5, 3, 4) (5, 3, 5) (5, 4, 2) (5, 4, 3) (5, 4, 4) (5, 4, 5) (6, 3, 3) (6, 3, 4) (6, 3, 5) (6, 3, 6) (6, 4, 2) (6, 5, 3)

PPC ∞ ∞ ∞ 0.6 0.9 1 1.6 ∞ 0.4 0.5 ∞ ∞ 0.5 10 ∞ ∞ 4 140 ∞ ∞ 0.6 ∞

LRS 28 29 30 0 0 1 1 25856 1 3 1592 16809 7 42 42 858 0 1 2 704 1 591

totaldeg 40 40 40 0 0 0 0 175 0 20 110 317 25 65 105 121 0 0 0 112 0 116

deg 0 0 0 0 0 0 0 140 0 20 90 207 20 40 40 16 0 0 0 112 0 80

Table 2: Timings and degrees for dense symmetric linear matrices We recall that m is the size of the input matrix, n is the number of variables and r is the expected maximum rank (that is, the index of the algebraic set Dr ). We compare our timings (reported in LRS) with those of the function PointsPerComponents (column PPC) of the library raglib developed by the third author [56]. The input of PointsPerComponents are the (r + 1) × (r + 1) minors of the linear matrix, and the output is a rational parametrization of a finite set meeting each connected component of Dr ∩ Rn . We do not consider the time needed to compute all the minors of A(x) in PPC. The symbol ∞ means that we did not succeed in computing the parametrizations after 48 hours. Column deg contains the degree of the parametrization returned by LowRankSymRec at Step 2, or 0 if the empty list is returned. Column totaldeg contains the sum of the values in deg for k varying between 1 and n. For example, for m = 4, r = 2, for n ≤ 2 and n ≥ 8 the algorithm does not compute critical points, while it computes rational parametrizations of degree respectively 10, 30, 42, 30, 10 for n = 3, 4, 5, 6, 7; the number 82 in totaldeg for (m, n, r) = (4, 2, 5) is obtained as the sum 10 + 30 + 42 of the integers in deg for m = 4, r = 2 and n = 3, 4, 5. We remark that, as for Table 1, the value in deg for a given triple m, n, r coincides with the algebraic degree of semidefinite programming, that is δ(n, m, r) as defined in [48]. Our algorithm allows to tackle examples that are out of reach for raglib and that, most 30

of the time, the growth in terms of running time is controlled when m, r are fixed. This shows that our dedicated algorithm leads to practical remarkable improvements: indeed, for example, 4 × 4 linear matrices of expected rank 2 are treated in a few minutes, up to linear sections of dimension 9; we are also able to sample hypersurfaces in R5 defined by the determinant of 5 × 5 symmetric linear matrices; finally, symmetric linear matrices of size up to 6 with many rank defects are shown to be tractable by our approach. We observe that most of the time is spent to compute a Gr¨obner basis of the Lagrange systems, and for this we use new fast algorithms for the change of monomial orderings [19].

6.2

Scheiderer’s spectrahedron

We consider the symmetric pencil     A(x) =    

1 0 x1 0 −3/2 − x2 x3

0 −2x1 1/2 x2 −2 − x4 −x5

x1 1/2 1 x4 0 x6

0 x2 x4 −2x3 + 2 x5 1/2

−3/2 − x2 −2 − x4 0 x5 −2x6 1/2

x3 −x5 x6 1/2 1/2 1

    .   

which is the Gram matrix of the trivariate polynomial f (u1 , u2 , u3 ) = u41 + u1 u32 + u42 − 3u21 u2 u3 − 4u1 u22 u3 + 2u21 u23 + u1 u33 + u2 u33 + u43 . In other words, f = v T A(x)v for all x ∈ R6 , where v = (u21 , u1 u2 , u22 , u1 u3 , u2 u3 , u23 ) is the monomial basis of the vector space of homogeneous polynomials of degree 2 in u1 , u2 , u3 . Since f is globally nonnegative, by Hilbert’s theorem [38] it is a sum of at most three squares in R[u1 , u2 , u3 ], namely there exist f1 , f2 , f3 ∈ R[u1 , u2 , u3 ] such that f = f12 + f22 + f32 . Moreover, the spectrahedron S = {x ∈ R6 : A(x)  0} parametrizes all the sum-of-squares decompositions of f (and it is a particular example of a Gram spectrahedron). Hence S must contain a matrix of rank at most 3. Scheiderer proved in [61] that f does not admit a sum-of-squares decomposition in the ring Q[u1 , u2 , u3 ], that is, the summands f1 , f2 , f3 cannot be chosen to have rational coefficients, answering a question of Sturmfels. We deduce that S does not contain points with rational coordinates. In particular, it is not full-dimensional (its affine hull has dimension ≤ 5) by straightforward density arguments. We first easily check that D0 ∩ R6 = D1 ∩ R6 = ∅). Further, for r = 2, the algorithm returns the following rational parametrization of D2 ∩ R6 : 

8 − 24t2 8 + 6t + 8t2 16 + 6t − 16t2 −3 − 16t 3 + 16t 3 + 16t , , , , , −8 + 24t2 −8 + 24t2 −8 + 24t2 −8 + 24t2 −8 + 24t2 −8 + 24t2

 .

where t satisfies 8t3 − 8t − 1 = 0. The set D2 is, indeed, of dimension 0, degree 3, and it contains only real points. Remark that the technical assumption P2 is not satisfied here, since the expected dimension of D2 is −1. Conversely, the regularity assumptions on the incidence varieties are satisfied. By applying CheckLMI one gets that two of the three points lie on S , that is those with the following floating point approximation up to 9

31

certified digits:        

−0.930402926 −1.000000000 0.731299211 −0.268700788 0.930402926 −0.930402926

      

      

and

−0.127050844 −1.000000000 −0.967716166 −1.967716166 0.127050844 −0.127050844

    .   

These correspond to the two distinct decompositions of f as a sum of 2 squares. An approximation of such representations can be computed by factorizing the matrix A(x(t∗ )) = V T V where t∗ is the corresponding root of 8t3 − 8t − 1 and V ∈ M2,6 (R) is full rank. The corresponding decomposition is f = v T V T V v = ||V v||2 . At the third point of D2 ∩ R6 the matrix A(x) is indefinite, so it is not a valid Gram matrix. To conclude, SolveLMI allows to design a computer-aided proof of Scheiderer’s results. This example is interesting since the interior of S is empty and, typically, this can lead to numerical problems when using interior-point algorithms.

7

Conclusion

We have presented a probabilistic exact algorithm that computes an algebraic representation of at least one feasible point of a LMI A(x)  0, or that detects emptiness of S = {x ∈ Rn : A(x)  0}. The algorithm works under assumptions which are proved to be generically satisfied. When these assumptions are not satisfied, the algorithm may return a wrong answer or raises an error (when the dimension of some Lagrange system is not 0). The main strategy is to reduce the input problem to a sequence of real root finding problems for the loci of rank defects of A(x): if S is not empty, we have shown that computing sample points on determinantal varieties is sufficient to sample S , and that it can be done efficiently. Indeed, the arithmetic complexity is essentially quadratic on a multilinear B´ezout bound on the output degree. This is, to our knowledge, the first exact computer algebra algorithm tailored to linear matrix inequalities. We conjecture that our algorithm is optimal since the degree of the output parametrization matches the algebraic degree of a generic semidefinite program, with expected rank equal to the minimal achievable rank on S . Since deciding the emptiness of S is a particular instance of computing the minimizer of a linear function over this set (namely, of a constant), our algorithm is able to compute minimal-rank solutions of special semidefinite programs, which is, in general, a hard computational task. Indeed, numerical interior-point algorithms typically return approximations of feasible matrices with maximal rank among the solutions (those lying in the relative interior of the optimal face). Moreover, the example of Scheiderer’s spectrahedron shows that we can also tackle degenerate situations with no interior point which are typically numerically troublesome. To conclude, as highlighted by the discussions in Section 6, our viewpoint includes an effective aspect, by which it is essential to translate into practice the complexity results that have been obtained. This is the objective of our maple library spectra. It must 32

be understood as a starting point towards a systematic exact computer algebra approach to semidefinite programming and related questions.

References [1] M. F. Anjos, J. B. Lasserre (editors). Handbook of semidefinite, conic and polynomial optimization. International Series in Operational Research and Management Science. Vol.166, Springer, New York, 2012. ´ Schost. On the geometry of polar [2] B. Bank, M. Giusti, J. Heintz, M. Safey El Din, E. varieties. Appl. Alg. in Eng., Comm. and Comp. 21(1):33–83, 2010. [3] B. Bank, M. Giusti, J. Heintz, G.-M. Mbakop. Polar varieties and efficient real elimination. Mathematische Zeitschrift, 238(1):115–144, 2001. [4] R. G. Bartle, D. R. Sherbert. Introduction to real analysis. John Wiley & Sons, New York, 1992. [5] S. Basu, R. Pollack, and M.-F. Roy. On the combinatorial and algebraic complexity of quantifier elimination. Journal of the ACM, 43(6):1002-1046, 1996. [6] S. Basu, R. Pollack, and M.-F. Roy. Algorithms in real algebraic geometry. Algorithms and Computation in Mathematics, Vol. 10. Springer Verlag, Berlin, 2006. [7] A. Ben-Tal, A. Nemirovski. Lectures on modern convex optimization: analysis, algorithms, engineering applications. MPS-SIAM Series on Optimization, SIAM, Philadelphia, 2001. [8] G. Blekherman, P. A. Parrilo, R. R. Thomas (Editors). Semidefinite optimization and convex algebraic geometry. SIAM, Philadelphia, 2013. [9] S.P. Boyd, L. El Ghaoui, E. Feron, V. Balakrishnan. Linear matrix inequalities in system and control theory. Studies in Applied Mathematics, Vol. 15. SIAM, Philadelphia, 1994. [10] S. Boyd, L. Vandenberghe. Semidefinite programming. SIAM Review, 38(1):49–95, 1996. [11] M. Claeys. Mesures d’occupation et relaxations semi-d´efinies pour la commande optimale. PhD thesis, LAAS CNRS, Univ. Toulouse, France, Oct. 2013. [12] G. Collins. Quantifier elimination for real closed fields by cylindrical algebraic decompostion. Automata Theory and Formal Languages, pages 134–183. Springer, Berlin, 1975. [13] D. A. Cox, J. Little, D. O’Shea. Ideals, varieties, and algorithms. 3rd edition, Springer, New York, 2007.

33

´ Sharp estimates for triangular sets, Proceedings of the [14] Dahan, X. and Schost, E.. 2004 international symposium on Symbolic and algebraic computation, pp. 103–110, 2004. [15] J. Draisma, E. Horobet, G. Ottaviani, B. Sturmfels, R.R. Thomas. The Euclidean distance degree of an algebraic variety. Found. of Comp. Math., 16(1):99–149, 2016. [16] D. Eisenbud. Commutative algebra with a view toward algebraic geometry. Springer, New York, 1995. [17] J.-C. Faug`ere. FGb: a library for computing Gr¨obner bases. In Mathematical Software–ICMS 2010, pages 84–87, Springer, Berlin, 2010. [18] J.-C. Faug`ere, M. Safey El Din, P.-J. Spaenlehauer. On the complexity of the generalized MinRank problem. J. of Symb. Comp. 55:30–58, 2013. [19] J.-C. Faug`ere, P. Gaudry, L. Huot, G. Renault. Polynomial systems solving by fast linear algebra. arXiv:1304.6039, Apr. 2013. [20] J.-C. Faug`ere, P. Gianni, D. Lazard, T. Mora. Efficient computation of zerodimensional Gr¨obner bases by change of ordering. J. of Symb. Comp., 16(4):329–344, 1993. [21] J.-C. Faug`ere, C. Mou. Sparse FGLM algorithms. arXiv:1304.1238, Apr. 2013. [22] J.-C. Faug`ere, M. Safey El Din and P.-J. Spaenlehauer. Critical points and Gr¨obner bases: the unmixed case. Proceedings of the 37th International Symposium on Symbolic and Algebraic Computation, pp. 162–169, 2012. [23] M. Giusti, G. Lecerf, B. Salvy. A Gr¨obner Free Alternative for Polynomial System Solving. Journal of Complexity, 17:154-211, 2011. [24] H.-C. Graf v. Bothmer, K. Ranestad. A general formula for the algebraic degree in semidefinite programming. Bulletin of LMS, 41:193–197, 2009. [25] A. Greuet, M. Safey El Din. Probabilistic algorithm for the global optimization of a polynomial over a real algebraic set. SIAM J. Opt., 24(3):1313–1343, 2014. [26] D. Grigoriev, N. Vorobjov. Solving systems of polynomial inequalities in subexponential time. J. of Symb. Comp., 5:37–64, 1988. [27] M. Gr¨otschel, L. Lov´asz, A. Schrijver. Geometric algorithms and combinatorial optimization. Springer, Berlin, 1988. [28] Q. Guo, M. Safey El Din, L. Zhi. Computing rational solutions of linear matrix inequalities. Proceedings of ISSAC 2013, Boston, USA, 2013. [29] F. Guo, E. Kaltofen, L. Zhi. Certificates of impossibility of Hilbert-Artin representations of a given degree for definite polynomials and functions. Proceedings of ISSAC 2012, Grenoble, France, 195–202, 2012.

34

[30] J. Harris. Algebraic geometry. A first course. Springer, New York, 1992. [31] J. Heintz, M.-F. Roy, P. Solern´o. Description of the connected components of a semialgebraic set in single exponential time. Disc. and Comp. Geom. 11:121–140, 1994. [32] J. W. Helton, J. Nie. Sufficient and necessary conditions for semidefinite representability of convex hulls and sets. SIAM J. Opt. 20, 759–791, 2009. [33] D. Henrion. Optimization on linear matrix inequalities for polynomial systems control. Lecture notes of the International Summer School of Automatic Control, Grenoble, France, 2014. [34] D. Henrion, S. Naldi, M. Safey El Din. Real root finding for determinants of linear matrices. J. of Symb. Comp. 74:205–238, 2016. [35] D. Henrion, S. Naldi, M. Safey El Din. Real root finding for rank defects in linear Hankel matrices. Proceedings of ISSAC 2015, Bath UK, 221–228, 2015. [36] D. Henrion, S. Naldi, M. Safey El Din. Real root finding for low rank linear matrices. arXiv:1506.05897, May 2015. [37] D. Henrion, J.B. Lasserre, C. Prieur, E. Tr´elat. Nonlinear optimal control via occupation measures and LMI relaxations. SIAM J. Control Opt. 47(4):1643–1666, 2008. ¨ [38] D. Hilbert. Uber die Dartstellung definiter Formen als Summe von Formenquadraten. Math. Ann. 32, 342–350, 1888. [39] G. Jeronimo, G. Matera, P. Solern´o, and A. Waissbein. Deformation techniques for sparse systems. Found. of Comp. Math., 9(1):1–50, 2009. [40] L. Khachiyan and L. Porkolab. On the complexity of semidefinite programs. J. Global Optim., 10:351365, 1997. [41] I. Klep, M. Schweighofer. An exact duality theory for semidefinite programming based on sums of squares. Mathematics of Operations Research, 38(3):569-590, 2013. [42] J.B. Lasserre. Global optimization with polynomials and the problem of moments. SIAM J. Opt., 11(3):796–817, 2001. [43] M. Laurent. Sums of squares, moment matrices and optimization over polynomials. In M. Putinar and S. Sullivant (Editors). Emerging Applications of Algebraic Geometry, Vol. 149 of IMA, Volumes in Mathematics and its Applications, 157–270, Springer, New York, 2009 [44] H. Lombardi, D. Perrucci, M.-F. Roy. An elementary recursive bound for the effective Positivestellensatz and Hilbert 17th problem. arXiv:1404.2338, 2014. [45] S. Melczer, B. Salvy. Symbolic-Numeric Tools for Analytic Combinatorics in Several Variables. Proceedings of ISSAC 2016, Waterloo, ACM, pp. 333–340, 2016. [46] Y. Nesterov and A. Nemirovsky. Interior-point polynomial algorithms in convex programming. Studies in Applied Mathematics 13. SIAM, Philadelphia, 1994. 35

[47] J. Nie. Optimality conditions and finite convergence of Lasserre’s hierarchy. Math. Progr. Ser. A, 146:97-121, 2014. [48] J. Nie, K. Ranestad, B. Sturmfels. The algebraic degree of semidefinite programming. Math. Progr. Ser. A, 122:379–405, 2010. [49] J. Nie, M. Schweighofer. On the complexity of Putinar Positivstellensatz. Journal of Complexity 23(1):135–150, 2007. [50] G. Ottaviani, P.-J. Spaenlehauer, B. Sturmfels. Exact solutions in structured lowrank approximation. SIAM J. Matrix Analysis Appl. 35(4):1521–1542, 2014. [51] V. Powers, T. Woermann. An algorithm for sums of squares of real polynomials. J. Pure and Appl. Alg. 127:99–104, 1998. [52] M. Putinar. Positive polynomials on compact sets. Indiana University Mathematics Journal. 42(3):969–984, 1993. [53] M. Ramana, A.J. Goldman. Some geometric results in semidefinite programming. J. Global Optim., 7:33–50, 1995. [54] J. Renegar. On the computational complexity and geometry of the first order theory of the reals. J. of Symb. Comp. 13(3):255–352, 1992. [55] F. Rouillier. Solving zero-dimensional systems through the rational univariate representation. Appl. Alg. in Eng., Comm. and Comp. 9(5):433–461, 1999. [56] M. Safey El Din. Raglib, Maple package. www-polsys.lip6.fr/˜safey [57] M. Safey El Din, L. Zhi. Computing rational points in convex semi-algebraic sets and sums of squares decompositions. SIAM J. Opt., 20(6):2876–2889, 2010. ´ Schost. Polar varieties and computation of one point in each [58] M. Safey El Din, E. connected component of a smooth real algebraic set. Proceedings of ISSAC 2003, Philadelphia, 2003. ´ Schost. Properness defects of projections and computation of one [59] M. Safey El Din, E. point in each connected component of a real algebraic set. Discrete and Computational Geometry, 32(3):417–430, 2004. ´ Schost. A nearly optimal algorithm for deciding connectivity [60] M. Safey El Din, E. queries in smooth and bounded real algebraic sets. arXiv:1307.7836, Jul. 2013. [61] C. Scheiderer. Sums of squares of polynomials with rational coefficients. arXiv:1209.2976, Sep. 2012. [62] C. Scheiderer. Semidefinite representation for convex hulls of real algebraic curves. arXiv:1208.3865, Aug. 2012. [63] I. Shafarevich. Basic algebraic geometry 1. Springer, Berlin, 1977.

36

[64] K. Schm¨ udgen. The K-moment problem for compact semi-algebraic sets. Math. Ann. 289:203–206, 1991. [65] M. Schweighofer. On the complexity of Schm¨ udgen Positivstellensatz. J. of Complexity 20, 529–543, 2004. [66] R. Sinn, B. Sturmfels. Generic spectrahedral shadows. SIAM J. Opt., 25(2):1209– 1220, 2015. [67] S. Tarbouriech, G. Garcia, J.M. Gomes da Silva, I. Queinnec. Stability and stabilization of linear systems with saturating actuators. Springer, London, 2011.

37