18

Background

It is known that there exists an oracle $A$ such that, $PSPACE^A \neq PH^A$.

It is even known that the separation holds relative to a random oracle. Informally, one may interpret this to mean that there are many oracles for which $PSPACE$ and $PH$ are separate.

Question

How complicated are these oracles that separate $PSPACE$ from $PH$. In particular, is there an oracle $A \in DTIME(2^{2^{n}})$ such that $PSPACE^A \neq PH^A$?

Do we have any oracle $A$ such that $PSPACE^A \neq PH^A$ and $A$ has a known complexity upper bound?

Note: the existence of such an oracle may have ramifications in structural complexity theory. See the following update below for further details.

Update with details on a lower bound technique

Claim: If $PSPACE = PH$, then for all oracles $A \in P/poly$, $PSPACE^A = PH^A$.

Proof Sketch: Suppose that $PSPACE = PH$.

Let an oracle $A \in P/poly$ be given. We can build a polynomial time $\Sigma_2$ oracle Turing machine $M$ that for a given length $n$, guesses a circuit of size $p(n)$ using an existential quantification and verifies that the circuit decides $A$ by comparing the evaluation of the circuit and the query result for every length $n$ string using a universal quantification.

Further, consider a decision problem that I'm referring to as quantified Boolean circuit (QBC) where you are given a quantified boolean circuit and want to know if it valid (similar to QBF). This problem is PSPACE-complete because QBF is PSPACE-complete.

By assumption, it follows that QBC $\in PH$. Let's say $QBC \in \Sigma_k$ for some $k$ sufficiently large. Let $N$ denote a polynomial time $\Sigma_k$ Turing machine that solves QBC.

We can intermingle the computation of $M$ and $N$ (similar to what is done in the proof of the Karp-Lipton theorem) to get a polynomial time $\Sigma_k$ oracle Turing machine that solves $QBC^A$.

Informally, this new machine takes as input an oracle QBC (that is a QBC with oracle gates). Then, it computes a circuit that computes $A$ on inputs of length $n$ (simultaneously pealing off the first two quantifiers). Next, it replaces the oracle gates in the oracle QBC with the circuit for $A$. Finally, it proceeds to apply the remainder of the polynomial time $\Sigma_k$ algorithm for solving $QBC$ on this modified instance.

Now, we can show the conditional lower bound.

Corollary: If there exists an oracle $A \in NEXP$ such that $PSPACE^A \neq PH^A$, then $NEXP \nsubseteq P/poly$.

Proof Sketch: Suppose that there exists $A \in NEXP$ such that $PSPACE^A \neq PH^A$. If $NEXP \subseteq P/poly$, then we would get a contradiction.

In particular, if $NEXP \subseteq P/poly$, then by the claim above we have $PSPACE \neq PH$. However, it is known that $NEXP \subseteq P/poly$ implies that $PSPACE = PH$.

(see here for some details on known results for P/poly)

Michael Wehar
  • 5,127
  • 1
  • 24
  • 54
  • Relevant survey paper on relativized separation results: Constructing Oracles by Lower Bound Techniques for Circuits by Ker-I Ko – Michael Wehar Apr 09 '17 at 06:24
  • 3
    It's probably worth mentioning that it's conjectured that PSPACE$\ne$PH. i.e. a trivial oracle would do, but we just can't prove it. – Thomas Apr 09 '17 at 06:37
  • 1
    How, exactly, do you define relativized PSPACE? More than one possibility appears in the literature. In particular, are oracle queries assumed to be polynomially bounded? – Emil Jeřábek Apr 09 '17 at 07:58
  • @EmilJeřábek That is a great point! So what are the two (or more) variants? Is it that one notion of relativized PSPACE only allows you to make polynomial sized queries because the space used on the query tape counts for the space complexity while the other notion doesn't count the space used on the query tape allowing you to write an exponential size query, but requiring that the tape be write only and that the tape is cleared after each query is made? – Michael Wehar Apr 09 '17 at 08:09
  • Please correct me if I'm wrong, but I think that the first notion is commonly used and is sufficient for obtaining the relativized separation results that I was referring to in the question. – Michael Wehar Apr 09 '17 at 08:10
  • Yes, on page 3 of the reference that I mentioned, it says, "including the space of the query tape". In other words, the first notion where the space on the query tape is counted is the one that I'm focusing on. :) – Michael Wehar Apr 09 '17 at 08:14
  • 1
    Do you include "The construction of Q formulas," large monotone boolean formulas that decide all 2^n qbfs of the original formula, in PH? See Introduction to QSpace, 2002 Satisfiability Conference, International workshop on QBFS, for more on Q formulas. – daniel pehoushek Apr 09 '17 at 09:09
  • 1
    I believe I can show, as a lower bound, that such an $A$ being in SEH would "have ramifications in structural complexity theory." ​ Should I post that fairly soon (which might mean tomorrow or might mean in 30 minutes), or leave this unanswered longer so you're more likely to get an answer with a class that suffices? ​ ​ ​ ​ –  Apr 09 '17 at 09:10
  • @RickyDemer Please feel free to share your lower bound! When I said "have ramifications in structural complexity theory", I had a certain lower bound in mind. In particular, I think I can show that if there exists an oracle $A \in NEXP$ such that $PSPACE^A \neq PH^A$, then $NEXP \nsubseteq P/poly$. – Michael Wehar Apr 09 '17 at 16:41
  • 1
    Given that random oracles have high Kolmogorov complexity, I would expect any computable upper bound on such oracles to have notable consequences. Strong upper bounds such as singly-exponential should have strong consequences. (Of course, this argument is purely heuristic and I currently have no idea how to make it rigorous.) – András Salamon Apr 09 '17 at 16:51
  • @danielpehoushek Hi Daniel, I don't know much about QPSACE, but I just downloaded your paper. With #Q, I think it's an interesting idea to count the number of quantifier arrangements that make a formula valid. I'm not quite sure that I understand QSPACE (the decision problem) though. Any help would be greatly appreciated. :) – Michael Wehar Apr 09 '17 at 17:05
  • @AndrásSalamon Thank you András! That could very well be the case. I guess I will write-up the result that I was referring to. It's nice to hear from you. Hope that all is going well. :) – Michael Wehar Apr 09 '17 at 17:07
  • 1
    (EXP^NP was my original result. ​ When I briefly looked at SEH, it seemed likely to be much bigger, which is why my previous comment mentioned that instead. ​ However, I subsequently noticed the zoo mentioning that class's collapse. ​ ​ ​ Since EXP^NP can simulate polynomial-length NE queries by padding, ​ SEH = P^NE $\subseteq$ EXP^NP , ​ so I wrote my answer with EXP^NP instead.) ​ ​ ​ ​ ​ ​ ​ ​ –  Apr 09 '17 at 18:08
  • @RickyDemer Very neat!! Thank you for sharing. :) – Michael Wehar Apr 09 '17 at 18:16
  • 1
    Your results can be easily strengthened to subsume mine: ​ ​ ​ Replace P/poly with PH/poly, refer to [machines taking advice] instead of circuits, and refer to max(advice_length,runtime) instead of circuit size. ​ Also, have the corollary be about EXP$^{\operatorname{NP}}$ instead of NEXP. ​ ​ ​ ​ ​ ​ ​ ​ –  Apr 09 '17 at 18:16
  • @RickyDemer Thank you Ricky!! I appreciate the strengthening. It helps. :) – Michael Wehar Apr 09 '17 at 18:18
  • 1
    (Incidentally, EXP$^{\operatorname{NP}}$ is pretty-much the largest thing that's not known to not be a subset of P/poly: $\hspace{.46 in}$ MA$_{\operatorname{EXP}}$ $\not\subseteq$ quasiP/quasipoly ​ is known via a non-relativizing argument.) ​ ​ ​ ​ –  Apr 09 '17 at 18:31
  • @RickyDemer That is very helpful information!! Thank you. :) – Michael Wehar Apr 09 '17 at 18:35
  • @RickyDemer Thank you again! I started looking a little deeper into the literature on this topic. I took a look at "Oracles Are Subtle But Not Malicious" and "Nonrelativizing Separations". :) – Michael Wehar Apr 10 '17 at 04:08
  • 1
    (Continuing the comments way up.) Another possibility is not to count the oracle tape against the space quota, and not to erase it (or move the head) after each use. On the other hand, when doing this, it might be also reasonable to limit the time of the computation to something exponential in the space quota. IMHO for a general-purpose definition of relativized space classes, it is indeed more natural not to count the oracle tape in the space allowance. For example, it would make no sense to demand that a relativized log-space algorithm may only make logarithmic-length queries. ... – Emil Jeřábek Apr 10 '17 at 13:35
  • 1
    ... There is nothing wrong with PSPACE algorithms making exponentially long queries per se; after all, no one bats an eyelid that relativized EXP algorithms may make exponentially long queries. Now, for the particular problem of relativized separation of PH and PSPACE, it seems that polynomially limited queries is the more interesting model, as relativized PH inherently has this limitation. But that’s why I asked for clarification. – Emil Jeřábek Apr 10 '17 at 13:38
  • @EmilJeřábek Thank you very much for the follow-up in regards to the oracle model. That makes sense. I wonder if there has been much work on relativized complexity classes with restricted query length? For example, relativized exponential time with quasi-polynomial query length. – Michael Wehar Apr 10 '17 at 14:25

1 Answers1

9

I believe if you trace through the argument given, e.g., in Section 4.1 of Ker-I Ko's survey, you get an upper bound of $\mathsf{DTIME}(2^{2^{O(n^2)}})$. In fact, we can replace $n^2$ here with any function $nf(n)$ where $f(n) \to \infty$ as $n \to \infty$. This isn't quite what was asked for, but it's close.

In particular, using the translation between oracle separations and circuit lower bounds, and following Ko's notation, we have the following:

  • We will diagonalize over strings of length $t(n) = p_n(m(n))$ where $p_n(x) = x^n + n$ is "the" $n$-th polynomial (in some enumeration of poly-time algorithms) and $m(n)$ will be specified below.

  • Translating into circuit lower bounds, this means we're considering bounded-depth circuits on $2^{t(n)}$ inputs.

  • The requirement (see p. 15 of Ko) we need $m(n)$ to satisfy $\frac{1}{10} 2^{m/(d-1)} > d p_n(m(n))$ for all $n$. Here $d$ is the depth of the circuits we want to diagonalize against, or equivalently the level $\mathsf{\Sigma_d^p}$ of $\mathsf{PH}$ we want to diagonalize against. To diagonalize against all of $\mathsf{PH}$, simply choose $d$ to be a function of $n$ that is $\omega(1)$; we may choose such a $d$ that grows arbitrarily slowly, though (perhaps subject to some computability assumption on $d(n)$, but that should be no obstacle). If we make the guess that $d(n)$ is constant (even though it's not, but it will grow arbitrarily slowly), then we see that $m(n)$ around $2^n$ should work.

  • This means that $t(n) \sim 2^{n^2}$, so we are looking for a lower bound against circuits with $\sim 2^{2^{n^2}}$ inputs.

  • Trevisan and Xue (CCC '13) showed that one can find an assignment on which a given bounded-depth circuit on $N$ inputs doesn't compute PARITY with a seed of $polylog(N)$ length.

  • For us $N=2^{2^{n^2}}$, so $polylog(N) = 2^{O(n^2)}$. We can brute force over such seeds in $2^{2^{O(n^2)}}$ time and use the first one that works.

To replace the $n^2$ with $nf(n)$, just let $p_n(x) = x^{f(n)} + f(n)$ instead.

Interestingly, if I'm understanding correctly, I believe this implies that if one could improve the Trevisan-Xue...

  • ...to a pseudodeterministic/Bellagio algorithm (see Andrew Morgan's comment below), one would get that $\mathsf{BPEXP} \not\subseteq \mathsf{P/poly}$; or

  • ...to a nondeterministic algorithm that guessed $polylog(N)$ bits but then ran in $poly(N)$ time, and such that on any accepting path it makes the same output (cf. $\mathsf{NPSV}$), it would imply $\mathsf{NEXP} \not\subseteq \mathsf{P/poly}$; or

  • ... to a deterministic algorithm, one would get $\mathsf{EXP} \not\subseteq \mathsf{P/poly}$.

On the one hand, this suggests why derandomizing the switching lemma further should be hard - an argument which I'm not sure was known before! On the other hand, this strikes me as a kind of interesting take on hardness versus randomness (or is this actually a new thing, oracles versus randomness?).

Joshua Grochow
  • 37,260
  • 4
  • 129
  • 228
  • 1
    Thank you very much for the answer Joshua!! I really appreciate it. :) – Michael Wehar Apr 10 '17 at 01:57
  • 1
    It seems that if we really do have an oracle $A \in BPEXP$ such that $PSPACE^A \neq PH^A$, then we have $BPEXP \nsubseteq P/poly$. – Michael Wehar Apr 10 '17 at 01:58
  • 1
    Has someone already proven $BPEXP \nsubseteq P/poly$? As @RickyDemer already said above, basically $EXP^{NP}$ is the largest class that could still possibly be a subset of $P/poly$. – Michael Wehar Apr 10 '17 at 02:01
  • 1
    Oh, hm, I must be misinterpreting something about Trevisan-Xue, since I'm pretty sure the smallest class known not to be in P/poly is $MA_{EXP}$, and this proof seems surprisingly easy to get such a result for BPEXP. I'll think about it a bit more. – Joshua Grochow Apr 10 '17 at 02:42
  • 1
    Oh wait, is it known that $BPEXP \subseteq P/poly \Rightarrow PSPACE=PH$? That was a key part of your proof for $NEXP$... – Joshua Grochow Apr 10 '17 at 03:06
  • 1
    Yep, it is. In particular, it is known that if $PSPACE \subseteq P/poly$, then $PSPACE = \Sigma_2 P$. Furthermore, because $PSPACE \subseteq BPEXP$, if $BPEXP \subseteq P/poly$, then $PSPACE = \Sigma_2 P$. – Michael Wehar Apr 10 '17 at 03:41
  • See here for more info: https://en.wikipedia.org/wiki/P/poly – Michael Wehar Apr 10 '17 at 03:42
  • 1
    Oh yeah, I knew that :]. Okay, so back to me looking more into Trevisan-Xue... – Joshua Grochow Apr 10 '17 at 03:55
  • Ok, great! Let me know what you come up with and we can discuss further. :) – Michael Wehar Apr 10 '17 at 03:59
  • 3
    One challenge that's glossed over here is that the oracle that's constructed has to be a single, fixed oracle, so that deciding it is in BPEXP or whatever. If you just pick a random seed of a good generator, then, while you do get some oracle that works, you don't necessarily get a decision procedure for that oracle, since different seeds give (in general) different oracles. You'd have to do something more, like finding a canonical seed, in order to make the construction actually "constructive". – Andrew Morgan Apr 10 '17 at 05:14
  • 1
    @AndrewMorgan: Ah, right! You'd need a $\mathsf{BPPSV}$ / pseudodeterministic / Bellagio algorithm to actually decide the oracle. But I think searching over all seeds should still give the deterministic time bound in my answer, as one can just search thru seeds exhaustively and use the first one that works (which is then a deterministically chosen "canonical" seed, even though it takes exponentially more time to find it). – Joshua Grochow Apr 10 '17 at 11:16
  • 3
    Even though the argument doesn’t give BPEXP, can you get the complexity down to a finite level of EXPH? – Emil Jeřábek Apr 10 '17 at 13:28
  • 2
    @EmilJeřábek: Without checking the details, I think $\mathsf{\Sigma_3 EXP}$ should work. Guess a seed using $\exists$, verify it works using $\forall$, and then verify that it is the lexicographically least seed using $\neg\exists\forall = \forall \exists \neg$, for a total of $\exists\forall\exists$. – Joshua Grochow Apr 10 '17 at 14:25
  • 2
    @EmilJerabek: Of course, if we could at least get this down to $\mathsf{MA_{EXP}}$ that would be even better (not improvable without proving new circuit lower bounds), but I don't yet see how to do that... – Joshua Grochow Apr 10 '17 at 14:32
  • 1
    @JoshuaGrochow: I'm not sure your verification step will run in time. We're diagonalizing against $\Sigma_k$ machines whose running times can be polynomials of any degree---brute forcing through all the nondeterminism takes time more than $2^{n^c}$ for any fixed $c$. Is there a better way? Maybe something can be done by supposing that the circuit lower bound fails (eg MA_EXP in P/poly) and then leveraging that. But that seems to be getting close to the ordinary proof that MA_EXP isn't in P/poly... (which is on the bottom of p. 297 of Arora-Barak). – Andrew Morgan Apr 10 '17 at 17:37
  • 1
    @AndrewMorgan: I think that is already taken into account in the third bullet point: $2^{m/(d-1)} > d p_n(m(n))$ where $p_n$ is the $n$-th polynomial. For $m$ sufficiently large (as I say, $~2^n$), it works against all polynomials simultaneously. Or am I misunderstanding your objection? – Joshua Grochow Apr 10 '17 at 17:58
  • 1
    @AndrewMorgan: Oh wait, or you were just talking about trying to get it down to $\mathsf{MA_{EXP}}$? I thought you were pointing out a flaw in the original argument. – Joshua Grochow Apr 10 '17 at 18:04
  • 1
    @JoshuaGrochow Yeah, I was objecting in the way you suspected. (And then mused on how to work around it.) Sorry I said it so confusingly; let me try again: In the $n$-th stage, $m(n)$ is the length where we make the main choices for our oracle, and $p_n(m)$ bounds the running time of the machine we're diagonalizing against. We want to use only $2^{m^c}$ time in the construction in order to be sufficiently constructive. However, the argument involves a circuit of size $2^{p_n(m)}$, and we can't actually afford to write down that whole thing. In particular, we can't just naively evaluate it. – Andrew Morgan Apr 10 '17 at 21:34
  • 1
    @AndrewMorgan: By choosing $m(n)=2^n$, we get that $2^{p_n(m(n))} \sim 2^{2^{n^2}}$, so we're dealing with circuits of size roughly $2^{2^{n^2}}$, which can be evaluated in roughly $2^{2^{n^2}}$ time. Even if we needed to make $2^{2^{O(n^2)}}$ such evaluations, the total time is still $2^{2^{O(n^2}}$. – Joshua Grochow Apr 10 '17 at 21:59
  • 1
    @JoshuaGrochow Right, but in order to say something like "the oracle is in EXP" or similar, one needs to show how to decide whether a given query q is in the oracle in time exponential in |q|. If we try to decide some q of length $m(n)$ (an input length where the oracle is nontrivial), then $2^{2^{n^2}} = 2^{m^{\log(m)}}$ time is too much. – Andrew Morgan Apr 10 '17 at 22:28
  • 1
    @AndrewMorgan: I never claimed the oracle was in $\mathsf{EXP}$, I claimed it was in $\mathsf{EEXP}$ (in particular, $\mathsf{DTIME}(2^{2^{O(|q|^2)}})$; note that in the answer I wrote $n$ instead of $|q|$, but this was an overuse of the parameter $n$ - this $n$ isn't the same as the $n$ in the construction). Given $q$ of length $2^k$, we can decide if $q$ is in the oracle in time $\sim 2^{2^{k^2}} = 2^{|q|^{\log |q|}}$, but $2^{|q|^{\log |q|}} = 2^{2^{\log^2|q|}} \leq 2^{2^{O(|q|^2)}}$ (so actually, the final upper bound on the oracle is $2^{quasi-poly(|q|)}$ rather than $2^{exp(|q|^2)}$). – Joshua Grochow Apr 10 '17 at 22:43
  • 2
    @JoshuaGrochow Yeah, your original post seems fine. I was objecting to your reply to Emil that hypothesized the oracle can be made in EXPH, where the running time is singly-exponential. In retrospect I should have been more clear about that. – Andrew Morgan Apr 10 '17 at 23:09
  • @AndrewMorgan Thank you both for going into all of these details! I really appreciate it. This has definitely helped me understand a bit better. :) – Michael Wehar Apr 11 '17 at 04:17