The Exponential Time Hypothesis Is False [pdf]
Posted by vok 2 days ago
See also: Announcing three new discoveries in mathematics, computer science, and physics - https://news.ycombinator.com/item?id=50251344
Comments
Comment by svat 2 days ago
- Early CS researchers like Donald Knuth entered CS in the days when regularly someone would come up with a surprising faster algorithm for some problem, and their intuitions were that most problems had faster algorithms than you'd expect.
- Later generations of CS researchers, as all the easy algorithms were discovered, and post Karp's definition of NP-completeness (and the Garey & Johnson book, say), began to specialize in proving hardness, and complexity theory with a “zoo” of complexity classes became more about separation and lower bounds, e.g. I've seen algorithms like Arora's PTAS for Euclidean TSP being described as a “failed attempt to prove a lower bound”. So an entire generation of researchers' intuition was mostly in the direction of an elegant universe with neat separation results (even if we couldn't get them).
- So e.g. surveys of computer scientists showed most of them believing that P≠NP, and someone like Knuth has always seemed a bit of an outlier for saying that maybe P=NP: his argument was simply that there are so many possible polynomial-time algorithms that we haven't explored, and maybe one of them with a large exponent could solve NP-complete problems. (In response to arguments that many researchers have failed to find any such algorithms, he would say that many researchers have failed to prove that P≠NP.) E.g. in 2017 when Scott Aaronson wrote his survey (https://www.scottaaronson.com/papers/pnp.pdf = https://www.scottaaronson.com/papers/pnp-kindle.pdf) he wrote:
> Admittedly, it can be hard to tell whether declarations that P = NP are meant seriously, or are merely attempts to be contrarian. However, we can surely agree with Knuth and Lipton that we’re far from understanding the limits of efficient computation, and that there are further surprises in store.
- What we've seen in this month is surprising unexpected algorithms, like o(n log n) algorithms for FFT and integer multiplication, and now this sub–exponential-time algorithm for 3-SAT. (Yes the ETH has had less support than P≠NP but I still gather it's unexpected.)
So (though I don't expect intuitions on P≠NP to change, and probably that's still the right intuition… but I'm just an interested amateur), maybe there will be a bit of a swing of the pendulum back to the idea that maybe clever algorithms exist that we just haven't thought of.
Comment by Animats 2 days ago
In cryptography, most of the problems believed to be exponentially hard, such as factoring, don't have proofs of an exponential lower bound. There's some risk of a breakthrough that makes those problems easier. A probabilistic solution would be good enough to break many cryptosystems.
I suspect that people at the cryptanalysis agencies worldwide are staying up late tonight, trying to figure out the impacts and risks of this new result.
Comment by vlovich123 2 days ago
Comment by robryk 1 day ago
These are by far not most, nor most of the practically useful ones. Directed graph reachability, given an adjacency list as input, is NL-hard.
Comment by svat 2 days ago
> In fact, one of the first things I wanted OpenAI to check is that no existing cryptosystems are compromised by the result. Apparently they are safe...
so if you trust his trust of OpenAI, then this has no (immediately obvious) bearing on cryptosystems for now.
Comment by luma 1 day ago
Comment by tomaskafka 1 day ago
Comment by w4der 1 day ago
Comment by Animats 2 days ago
Comment by marcus_holmes 1 day ago
Comment by FlyingCanoe 2 days ago
It also not probabilistic, so linear programing is not rely a good example
Comment by m-chrzan 1 day ago
Comment by caughtinthought 1 day ago
Comment by LPisGood 1 day ago
It is notable that simplex, especially dual simplex is often better in practice, especially for integer linear programming with branch and bound because you only have to slightly modify the parent optimal basis in simplex vs entirely restarting or refactorizing for interior point methods.
Comment by williamstein 1 day ago
There are subexponential algorithms for integer factorization, e.g., the general number field sieve and Lenstra’s ECM.
Comment by marcosdumay 1 day ago
Comment by wslh 1 day ago
Actually, integer factorization already has subexponential-time algorithms, such as the General Number Field Sieve (GNFS).
Comment by Ar-Curunir 1 day ago
Comment by slashtrends 2 days ago
Comment by devy 2 days ago
The fact that other math problems are bulk solved yet nothing from cryptography was released/published as solved could be a strong indicator that "all modern public key based cryptography" could have been at risk.
Comment by hathawsh 2 days ago
Comment by freehorse 1 day ago
Comment by murderfs 2 days ago
Comment by bscphil 1 day ago
Comment by treebeard901 1 day ago
Comment by Maxion 1 day ago
Comment by Someone 1 day ago
“Could be”, but I think the correct way to describe it is “the general public doesn’t know”. It could be any of
- they tried very hard without finding weak spots
- they tried for a while, and gave up because the LLMs didn’t even produce leads
- they tried, found something and kept it for themselves
I think the first is not unlikely. Before LLMs, the likes of the NSA must have looked really hard into these problems, and IMO it’s not likely they found something substantial (if they did, their counterpoints in other large countries likely would find it, too, and some of them would have used that knowledge)
Comment by orangecat 1 day ago
Comment by freehorse 1 day ago
Comment by sampo 2 days ago
Here's a nice low-budget scifi movie about this:
https://en.wikipedia.org/wiki/Travelling_Salesman_(2012_film...
https://www.youtube.com/watch?v=OgeyHkP6i3g (full movie)
Comment by bananaflag 2 days ago
Comment by kenjackson 1 day ago
Comment by yablak 1 day ago
Comment by steezeburger 2 days ago
Comment by skissane 2 days ago
I mean if someone develops an O(n^100) algorithm for solving an NP-complete problem, that would prove P=NP, but pose no immediate threat to cryptography.
It increases risk, in that a galactic algorithm increases the odds that an efficient algorithm exists waiting to be found, but it is entirely (epistemically) possible that the galactic algorithm exists but the efficient algorithm doesn't.
Comment by fpoling 2 days ago
Comment by Dylan16807 1 day ago
Comment by skissane 1 day ago
Comment by Dylan16807 1 day ago
Comment by elfly 18 hours ago
Given the current developments, I would not be confident that it would not lower dramatically pretty soon.
Comment by mattm 2 days ago
Comment by squidmaster 1 day ago
Comment by dingdongditchme 1 day ago
Comment by vanderZwan 1 day ago
https://www.informit.com/articles/article.aspx?p=2213858&WT....
> Don Knuth: As you say, I've come to believe that P = N P, namely that there does exist an integer M and an algorithm that will solve every n-bit problem belonging to the class N P in n**M elementary steps.
Comment by dingdongditchme 1 day ago
Comment by zahlman 1 day ago
…Oh, I see. The M here is a hypothesized constant, with n as the base. That's how polynomial time looks. Exponential time would have n in the exponent.
Comment by kscarlet 1 day ago
Comment by dingdongditchme 1 day ago
Comment by Ohentis 1 day ago
Comment by dingdongditchme 23 hours ago
Comment by zahlman 1 day ago
> In 2019, Harvey and van der Hoeven came up with a galactic algorithm with complexity O ( n log n ) {\displaystyle O(n\log n)}. This matches a guess by Schönhage and Strassen that this would be the optimal bound.
> In September 2026, OpenAI released a preprint claiming an algorithm with complexity O ( n ( log n ) α ) {\displaystyle O(n(\log n)^{\alpha })} with α < 1 {\displaystyle \alpha <1}
https://en.wikipedia.org/wiki/Multiplication_algorithm
That said, it's interesting to contemplate that there is "space between" polynomial and exponential time complexities.
Comment by lukasgelbmann 1 day ago
Yes, svat’s comment accounts for that by using little-o notation* in o(n log n). This was only achieved in the 2026 result.
Comment by cochne 2 days ago
Edit: To explain more, it is guaranteed that you can reduce any NP problem to 3SAT in polynomial time with a polynomial factor in input size. You still have to solve it.
If 3SAT were solvable in polynomial time, then polynomial(polynomial(x)) = polynomial(x) and you're implied to have an overall polynomial time solution.
But what we have here is that 3SAT is solveable in subexponential time. subexponential(polynomial(x)) is not guaranteed to be sub-exponential.
Further edit: The subexponential solution does carry over to any (?) problems that have can be reduced to 3SAT in a linear number of variables. They list: Counting independent sets, Counting proper q-colorings, Counting perfect matchings.
Comment by marshray 2 days ago
Wouldn't that also include functions that can be evaluated in hardware using a fixed number of gates? E.g., symmetric cryptography?
Comment by pcbouman 2 days ago
Comment by ReptileMan 1 day ago
Comment by LPisGood 2 days ago
Is there a subset of NP problems for which a subexponential algorithm would witness the entire NP class being subexponential?
Comment by eli_gottlieb 2 days ago
EDIT: DISREGARD THAT I WAS MISTAKEN
Comment by csheehan10 2 days ago
If subexponential just means 2^{o(n)}, (as it is here, O(2^{n/\sqrt{\log n}})), then no. E.g. if the cost of the reduction took you from n to \sqrt{\log n}n, then you'd be back to exponential time. The Subexponential Reduction Family is the class of problems that preserve subexponential time in the second sense.
Comment by LPisGood 2 days ago
Comment by demibabs 2 days ago
Comment by triMichael 2 days ago
Put these two together and you would think that they would mean that any NP complete problem can be solved in sub-exponential time. But this isn't necessarily true because changing the NP complete problem into 3SAT can increase the number of variables, which can theoretically negate the sub-exponential time.
Comment by demibabs 2 days ago
(By the way, I think you mean NP-complete, not NP-hard. The Halting Problem is NP-hard.)
Comment by edanm 1 day ago
Comment by isaacfrond 1 day ago
Comment by triMichael 2 days ago
Comment by bluepoint 21 hours ago
Edit: Ok, I a guess I am wrong if the reduction is n^ log n/(log log n)^2 we are back to exponential.
Comment by bobmarleybiceps 2 days ago
Comment by sourdecor 2 days ago
Comment by gbacon 1 day ago
So the reduction to 3SAT could happen in principle, but it isn’t a necessary step.
Comment by imadr 2 days ago
P=/=NP -> 3SAT has no polynomial-time algorithm
ETH is true -> 3SAT has no subexponential time algorithm
ETH is false -> 3SAT has a subexponential time algorithm
------
ETH true -> P=/=NP
ETH false (!!!) -> P ?= NP remain unsolved
Comment by demibabs 2 days ago
Comment by nightshade1511 2 days ago
Comment by Aunche 2 days ago
Comment by stbede 2 days ago
but
2^(sqrt(n)^2) = 2^n
Comment by raegis 2 days ago
Comment by Dylan16807 1 day ago
This also means your other comment here is wrong to suggest any error: https://news.ycombinator.com/item?id=50254142
Comment by raegis 1 day ago
Comment by jballanc 2 days ago
Comment by Dylan16807 1 day ago
Comment by caughtinthought 2 days ago
So 3SAT+poly reduction ends up being exponential
Comment by demibabs 2 days ago
Comment by csheehan10 2 days ago
In this case they have c = 1-0.5(\log \log n)/(\log n) which is approaching 1 for large n.
Comment by imadr 2 days ago
Comment by vote_farisa_202 2 days ago
It's still a big result, but it's mostly theoretical. It might help explain, structurally, why most SAT instances are far easier than an exponential model would indicate.
Comment by calf 2 days ago
Comment by shoo 2 days ago
then 2^(n^(1-epsilon)) belongs to 2^o(n)
Suppose p(n) is some polyonomial in n, our polynomial reduction. Let's make it a monomial for simplicity, p(n) = n^a
Does 2^(p(n)^(1-epsilon)) necessary belong to 2^o(n)?
No, that only holds if (n^a)^(1-epsilon) = n^(a (1-epsilon) ) < n^1 . So, it fails for p(n) = n^a for any a such that a >= 1/(1-epsilon)
Comment by gewetensleegte 1 day ago
No, subexponential is not the same as polynomial time. There's sub-exponential functions that grow faster than polynomial.
Comment by tomaskafka 1 day ago
> Somehow, their wide range of results touch every single area of math except anything touching cryptography. I think it's fair to expect that three letter agencies are given the ability to veto the publication of certain discoveries.
Comment by dguest 1 day ago
The big AI companies spend millions on some of these proofs (15M was one estimate for the Naiver-Stokes thing). Had anyone has spent millions on them before this? There was a 1M prize but that certainly wouldn't convince anyone to spend orders of magnitude more to solve the problem.
Meanwhile the three letter agencies are spending billions on cryptography. They have programs that recruit students starting in high school. So maybe they are sending the spooks to suppress OpenAI's cryptography breakthroughs, or maybe they just already outspent them.
That to me is the point that isn't getting enough attention: pure math isn't that well funded. I agree as much as anyone that these proofs are an unprecedented breakthrough for LLMs, but let's keep in mind that the money they are throwing around is also unprecedented.
Comment by Davidzheng 1 day ago
Comment by snowwrestler 1 day ago
It’s possible they have major findings in crypto but are coordinating disclosure. The PHP bug was worked for months and only leaked a few hours early.
It’s also possible they have not found any major flaws yet. The math underlying major cryptography libraries is way simpler than these advanced proofs, and the implementations among the most scrutinized and hardened bits of code in the world.
The PHP bug paradoxically gave me hope. It was not magic; it was a logic flaw that was already known for years. And exploiting it has proved way more difficult than initially feared.
Comment by paxy 1 day ago
Comment by brookst 1 day ago
Comment by tomaskafka 1 day ago
Comment by fxwin 1 day ago
Comment by seizethecheese 1 day ago
I think the premise does support the conclusion that there's some mechanism suppressing release, though.
Comment by dachtovyvse 1 day ago
Comment by baoooooooooooo 1 day ago
If I were to start inferring what’s going on, it’s that findings in this space have relevance to breaking current weak cryptography.
Comment by strommec 2 days ago
> We prove that the time complexity of self-attention is necessarily quadratic in the input length, unless the Strong Exponential Time Hypothesis (SETH) is false[...]
If OpenAI's proof is correct, does that mean self-attention can be implemented in sub-quadratic time? I.e. we could eventually have all the most advanced LLMs running on cheap hardware? To put it more playfully, is ETH being false actually bearish for Nvidia?
Comment by rokob 2 days ago
Comment by dnautics 2 days ago
Comment by Xirdus 2 days ago
Comment by programjames 2 days ago
Comment by _ink_ 1 day ago
Comment by caughtinthought 2 days ago
Comment by jibalt 2 days ago
What is relevant is that the logic goes the other way: SETH implies quadratic, !SETH implies nothing.
Comment by varyherb 2 days ago
Comment by margalabargala 2 days ago
Comment by refulgentis 2 days ago
But it's also not even wrong, in the Pauli sense.
That makes me wonder if "I see your CS proof, how does this affect LLMs / nvidia stonk price???" being immediately self-described as "playful" ensures criticism looks cranky.
Comment by Joker_vD 2 days ago
Turns out, it affected the global politics tremendously.
Comment by zodiac 2 days ago
Comment by qnleigh 23 hours ago
> Our result is purely asymptotic: for arbitrary 3-CNF formulas with m = 5n clauses, the bound we prove does not improve on the 2n of exhaustive search unless n > 10^10000,
So their algorithm beats standard algorithms only when you have more variables than there are atoms in the universe (10^80). Even if every atom contained a whole universe, and each atom in each universe itself contained a whole universe, iterated 100 times, your still not there.
Comment by tkgally 1 day ago
Comment by Davidzheng 1 day ago
Comment by hurfdurf 1 day ago
Comment by criemen 2 days ago
Can an expert in sat solving comment if there's any immediate applications of the method from the paper? Or is SAT solving in general pretty far away from worst-case times, and this is a theoretical algorithm which would be hard to apply in practice.
Comment by bsubs 2 days ago
Comment by sebmellen 2 days ago
Comment by angry_octet 1 day ago
Comment by chr15m 2 days ago
Comment by ashkankiani 2 days ago
Comment by yyyk 2 days ago
** Yes, I know that's proven to be impossible.
Comment by MichaelDickens 2 days ago
If objects have a maximum size of 4 GB (= 2^35 bits), then arbitrary objects can be sorted in O(n) using 2^2^35 bits of memory.
Comment by yyyk 2 days ago
Comment by adrianN 2 days ago
Comment by adgjlsfhk1 2 days ago
Comment by kite42 2 days ago
Comment by gradus_ad 2 days ago
Comment by zahlman 1 day ago
Yes, I think we can pretty safely say that the algorithm in the paper is not used due to practical constraints. This is a subjective judgment, but pretty clear from the paper that the algorithms aren't practical to apply.
Comment by infamouscow 2 days ago
Comment by kingstnap 2 days ago
Comment by softwaredoug 2 days ago
I'm reminded of the Apollo program that was cool for a while, but eventually the public lost interest.
Maybe it becomes cheaper? Maybe other labs want to prove their worth will pick up the slack when another loses interest?
Comment by adgjlsfhk1 2 days ago
Comment by paxy 2 days ago
Comment by baq 2 days ago
Comment by geraneum 1 day ago
Comment by mark_something 1 day ago
Comment by FuckButtons 1 day ago
Comment by geraneum 1 day ago
Comment by squidmaster 1 day ago
Comment by Philpax 2 days ago
Comment by TheImmortalPyth 1 day ago
Comment by qgin 2 days ago
Comment by jibalt 2 days ago
Comment by pxx 2 days ago
sure, this proof itself doesn't settle the P/NP problem, but we've lost one of our core beliefs.
Comment by jibalt 2 days ago
Comment by caughtinthought 1 day ago
Comment by mathgladiator 2 days ago
Comment by spr-alex 1 day ago
Comment by bananaflag 2 days ago
Comment by mlmonkey 2 days ago
Comment by ehershey 2 days ago
In computer science, the satisfiability problem is the task of determining whether a boolean problem can be satisfied, that is, made to be true, by some combination of inputs. For example, the expression: A AND NOT B is satisfied whenever A is true and B is false, while the expression: A AND NOT A cannot be satisfied.
A naive approach to satisfiablilty would be to check every possible input and see if the expression evaluates to true.
However, the number of combinations that must be checked is 2n, where n is the number of variables in the expression. This is what is meant by exponential time.
The exponential time hypothesis conjectures that you cannot do better, that is, the number of operations needed to solve satisfiability will always be exponential in the size of the problem, no matter what algorithm is chosen.
If this hypothesis is true, it would imply that P≠NP, because satisfiability has been shown to be in NP, and in order for it to be in P there would have to exist an algorithm that solves it in polynomial time.Comment by gberger 2 days ago
Comment by newsy-combi 2 days ago
Comment by pvab3 2 days ago
Comment by nullc 2 days ago
A common complexity theory misunderstanding is that statements like this applies to all or even most instances-- and it leads to objectively bad engineering of the form "oh look this is actually 3sat, it's unsolvable".
(Great fodder for a midwit meme: idiot and genius say "my heuristics go brrr!"-- midwit says "No no no! NP problems can't be efficiently solved!")
Any specific instance may be efficiently solvable (and perhaps all instances coming from your particular problem set -- a subset of all possible 3sats).
So I would add to that paragraph "at least for some 3sat instances".
Comment by marshray 2 days ago
Comment by SyzygyRhythm 2 days ago
The Exponential Time Hypothesis in effect says that 3SAT can only be solved by brute force--trying every possible combination until you find the right one. If your 3SAT expression has 100 variables, then this will take about 2^100 tries (exponential time).
What they found was an algorithm faster than brute force. 3SAT is still potentially one of these hard problems, but finding anything faster than brute force is a major advance.
Comment by pcstl 2 days ago
NP-complete problems are essentially those where you need to make some kind of choice over a superlinearly-growing set of options where each option can be solved in polynomial time. Like, for example, finding a route between cities on a map under a certain total distance. You might need to go over all choices of routes.
The ETH essentially assumes that the best solution (in terms of complexity, i.e. how it grows) you can get for these kinds of problems is exponential. OpenAI just proved that this is false, you can have solutions that are below exponential complexity (but still above polynomial - if anyone finds a polynomial solution then we'd have proven that P=NP)
Comment by eru 2 days ago
Seems like a weird way to describe NP, and I'm not even sure it's true?
NP is the class of decision problems where if the answer is YES and someone slips you a hint, you can solve them quickly (or quickly figure out that the hint was useless and report that). Where quickly means in polynomial time.
There's nothing about linear time in the classic definition.
Comment by pcstl 2 days ago
NP = nondeterministically polynomial. i.e. if you could evaluate all choices in parallel (or just "know" the right choice), then you'd get a polynomial runtime. That's what I was trying to informally hint at, but I ended up using the wrong term. I'll edit my original post.
That's equivalent to your description - the "hint" is knowing which of the options to choose.
The reason why superlinearity comes into play is that if you had a linearly growing amount of solutions to test then you'd just have a sum of polynomials, which is itself polynomial.
Comment by eru 2 days ago
One nitpick: I think your set of options needs to grow a lot faster than just superlinearly, I suspect it needs to grew superpolynomially?
However otherwise what you describe is essentially true of all problems in NP, not just the NP hard problems:
Sorting is (trivially) in NP, and you can say that to sort you need to pick one out of n! many permutations (which certainly grows superlinearly and even superpolynomially).
NP hard problems have the distinction that if you solve one of them efficiently, you can solve all of them efficiently, because you can reduce them to each other. (Basically because NP hard problems allow you to sort-of describe a computer, and reducing them to each other is equivalent to writing an interpreter or compiler.)
Comment by dnautics 2 days ago
P means "this problem can be solved in polynomial # of steps relative to the problem size"
NP means "we don't know if the problem can be solved in polynomial # of steps relative to problem size, but we know we can check if the result is correct in a polynomial # of steps relative to the problem size"
!ETH: it was widely suspected that the flagship problem in NP, 3SAT, requires an exponential # of steps relative to problem size. We now know that 3SAT requires AT MOST something more than polynomial but strictly less than exponential to solve.
"P = NP" means "if you can check it in polynomial time, there's some way to solve it in polynomial time". "P != NP" means "there are some problems checkable in polynomial time for which there is no polynomial way to obtain the result"
Today's new proof makes "P = NP" "feel more likely", because we know that the flagship problem in NP is not exponential.
Comment by tfpgh 2 days ago
Solving an arbitrary NP problem looks like first reducing that problem to SAT and then solving the equivalent SAT problem. We know (via the Cook–Levin theorem) that any NP problem can be reduced to SAT in polynomial time, and we now know that solving SAT is subexponential in terms of the size of the SAT problem, but it's possible for the conversion to SAT to grow the problem enough that it's exponential in terms of the original problem.
Comment by dnautics 2 days ago
Comment by jibalt 2 days ago
It seems to me that the logic only goes the other way ... if ETH had been proven then it would follow that P != NP. With !ETH we really don't know any more about P ?= NP then we did before. Reasoning that P = NP is "more likely" strikes me as a form of a fallacy of affirming the consequent.
Comment by dnautics 1 day ago
Comment by caughtinthought 2 days ago
Fwiw never thought it was a well-named conjecture
Comment by pcstl 2 days ago
This proves that EXP != NP
Comment by jibalt 2 days ago
Note https://news.ycombinator.com/item?id=50253213 which explains it better.
Comment by caughtinthought 2 days ago
Comment by pcstl 2 days ago
Comment by moishe_syzslak 2 days ago
Comment by jibalt 2 days ago
Comment by caughtinthought 2 days ago
Comment by js8 2 days ago
Comment by lisper 2 days ago
Comment by krackers 2 days ago
And the result that it's now false apparently doesn't imply NP!=EXPTIME either since it seems not strongly subexponential enough to offset the expansion in variables from reductions. See the other comments for a much better explanation.]
Comment by eru 2 days ago
It's a bit more complicated than that, if you want to be careful. Sorting is in both NP and EXP and can be solved in subexponential time.
I think what they proved is that no problem in NP takes exponential time to solve. (Because you can always reduce them to SAT in polynomial time, and then solve SAT in subexponential time.)
EDIT: apparently the runtime bounds they gave here don't survive the usual polynomial reductions, thus they haven't proven that NP != EXP, it seems.
Comment by luc4 2 days ago
Comment by lynndotpy 2 days ago
This means hard problems aren't as hard as we thought, and it's still possible P=NP. If it turns out to be true P=NP, we're a little closer to that. (I hope P!=NP!)
Every paper which assumes ETH is true might now have their conclusions be disproven.
Comment by cochne 2 days ago
Comment by wbl 2 days ago
Comment by cochne 2 days ago
Comment by adgjlsfhk1 2 days ago
Comment by jibalt 2 days ago
Comment by adgjlsfhk1 2 days ago
Also for NP problems that can't linear reduce to kSAT just having the knowledge that SAT is sub-exponential (and the tools), makes it a lot more likely that we see a whole lot more problems become exponential.
Comment by calf 2 days ago
Comment by mswphd 2 days ago
Comment by jibalt 2 days ago
Note https://news.ycombinator.com/item?id=50253213 which explains it better.
Comment by LPisGood 2 days ago
Comment by dataflow 2 days ago
Comment by lynndotpy 1 day ago
NP is not yet proven to be subexponential but still, ETH disproven is huge
Comment by jaggederest 2 days ago
strong exponential time hypothesis, and the titular exponential time hypothesis
It's not saying that these problems are easy, but it does demonstrate that they are much easier than previously believed. A decade ago if a human had published this kind of thing, and importantly if it held up, they would be almost certainly a strong candidate for some sort of award(s).
Comment by thatoneengineer 2 days ago
Comment by jibalt 2 days ago
Note https://news.ycombinator.com/item?id=50253213 which explains it better.
Comment by xigoi 1 day ago
Comment by zeroonetwothree 2 days ago
Comment by xigoi 1 day ago
Comment by SkiFire13 1 day ago
Comment by kakapo5672 2 days ago
Comment by mudita 2 days ago
Comment by zeroonetwothree 2 days ago
Comment by kibwen 2 days ago
Comment by internetter 2 days ago
Comment by jibalt 2 days ago
Comment by howunfortunate 2 days ago
Comment by throw-qqqqq 1 day ago
It doesn’t matter if I bet $N on something using cash or margin, my exposure is still $N.
Since you can’t have unlimited exposure, this would still lock up capital, until the bet can be resolved.
Comment by jibalt 2 days ago
Comment by FeepingCreature 1 day ago
Comment by Tadpole9181 2 days ago
Comment by internetter 2 days ago
Comment by hanyao_pan 1 day ago
Comment by pcstl 2 days ago
In a way it shows that NP is perhaps less distant from P than imagined. Whether it can be _reduced_ to P in some gigabrain way, or whether that can be shown to be impossible remains to be seen.
It is definitely progress towards an answer to P ?= NP.
Comment by jibalt 2 days ago
Note https://news.ycombinator.com/item?id=50253213 which explains it better.
Comment by pcstl 1 day ago
Comment by IsTom 2 days ago
It's conceivable that each of them is smaller than the next, but also that e.g. P < NP = all the sigmas < PSPACE < EXPTIME or many other possibilities. I think the general consensus is that it's more likely that there are more inequalities than not, but the fact is that we can't even show that P is less than PSPACE so far, which would be extraordinarily surprising if it were true.
Comment by caughtinthought 2 days ago
Comment by jibalt 2 days ago
Note https://news.ycombinator.com/item?id=50253213 which explains it better.
Comment by amelius 2 days ago
Comment by odyssey7 2 days ago
Still, an impressive accomplishment.
Comment by adgjlsfhk1 2 days ago
Comment by nemo44x 2 days ago
Comment by kpietroszek 6 hours ago
Comment by punty 1 day ago
Maybe it's a bit early to predict here but it feels like this approach might have a series of improvements similar to the progress made on the faster FFT multiplcation result.
Comment by JonChesterfield 2 days ago
the constructed lookup machine has vastly more states than the estimated total number of physically distinguishable configurations of the observable universe.
I'm not inclined to consider "wrote down all the answers ahead of time, so that's free" as a quadratic time solution to SAT. Nor very convinced by the other half.So on balance, if this is considered proof that the exponential time hypothesis is false, and openai model reading of the lean was vaguely on point, then I reject the axioms of this system. Not a proof, even if there is lean. I'm OK with being downvoted for that position.
Comment by hansvm 2 days ago
Comment by adgjlsfhk1 2 days ago
Comment by hansvm 2 days ago
[0] Very much not something I care much about in these sorts of conversations. Even if it weren't galactic, a random logn factor here and there usually loses to cache efficiency and whatnot. Their speedups were less than that, and I'd already assumed we were in the realm of applied math rather than real engineering.
Comment by adgjlsfhk1 2 days ago
Not quite. This result uses polylog(n) precision which isn't bounded, so it escapes the previous bounds. This doesn't noticably affect the runtime because not all of the math needs this extra precision (in this case you need a couple computations in higher precision but less than n operations), so the extra precision can be payed for even in a TM/circuit model.
Comment by lg5689 2 days ago
Comment by adgjlsfhk1 1 day ago
Comment by choeger 1 day ago
I have no intuition whatsoever on how that algorithm scales. Can anyone enlighten me?
Comment by SkiFire13 1 day ago
Comment by punty 1 day ago
Comment by rnbnnnn 2 days ago
Higgledy-piggledy,
Exp. Time Hypothesis:
Runtime complexity
Soars to the sky.
Subexponentially,
Tensor contractions have
Tallied solutions for
OpenAI.Comment by zahlman 1 day ago
Comment by marshray 2 days ago
Doesn't that lead me to an existence proof (i.e., a solution) to a k-SAT problem in N*(subexponential_time and polynomial_space)?
And with constant folding, N is reduced by 1 on each iteration.
What obvious thing am I missing here?
Comment by grumpymuppet 1 day ago
Comment by airtnp 2 days ago
Comment by reenorap 2 days ago
Comment by hardbass 1 day ago
Comment by bozdemir 1 day ago
Comment by moktonar 1 day ago
Comment by antics 2 days ago
This has been marginally debated since the mid 90s, when Impagliazzo published the “5 worlds” survey. Occasionally it is brought up in talks about average case analysis. There is occasionally a workshop about it. But it has never really got the attention it deserved. How many more of these results do we need to take it seriously? (Assuming we do indeed certify it.)
Comment by eru 2 days ago
What do you mean? Do you mean that our heuristics shortcuts of treating P as efficiently solvable (and NP as efficiently verifiable) are not warranted? So far pretty much all algorithms in P that we found have small exponents. That hasn't changed, but it might change in the future.
Or do you mean something else?
Keep in mind that even most instances of many NP hard problems can be solved very efficiently in practice, because most instances ain't hard.
However we know problems that are expected to be 'easier' than NP that are hard to solve in practice. These are pretty much all the problems we build cryptography out of, because essentially these problems are in the intersection of NP and co-NP and that's expected to be smaller than NP. And cryptography has to be hard to break on average to work: a random key needs to be a good key.
> and P \in NP is actually ill-posed.
Oh, that's very simple to answer: P is not an element of NP. The question people care about is whether there's any element in NP that's not in P. In LaTeX notation P \subset NP vs P \subseteq NP.
I'm not sure what you mean by ill-posed? The question is very clear. What are you trying to say?
Comment by antics 2 days ago
There are many ways it might turn out to be ill-posed, this is just one of them. Impagliazzo's "5 worlds" survey is in some sense a catalog of some of these ways, and includes some of the ways you seem to be referencing (approxmations, probabilistic techniques, average-case efficiency; depending what you mean this could lie in the "Heuristica" world).
Comment by eru 2 days ago
OK, that's a reasonable worry and one that practitioners share. Thanks for explaining. Though I don't think ill-posed is a good term for this, the technical meaning of the term points in a different direction.
So far, as far as I can tell this new result gives much of any extra credence to that worry.
Comment by antics 2 days ago
Comment by eru 1 day ago
The problem is that this formal question might not correspond to the informal question we actually care about.
Comment by antics 1 day ago
Comment by eru 19 hours ago
However, so far equating P with 'efficient in practice' seems to hold up.
Comment by antics 7 hours ago
Comment by calf 1 day ago
I'm also confused what you are saying down here. Though I can see how "sub-exponential" is easily misleading terminology.
Comment by antics 1 day ago
In essentially all cases, we have no real reason to believe or disbelieve. We choose these bounds because we can't do better. It's often the case that we later prove them wrong with some extremely strange result. Here, we have weird bounds for 3-SAT, and a few weeks ago we had one for integer multiplication.
But this has also happened repeatedly throughout history. In the 50s Kolmogorov conjectured that n-bit integer multiplication was \Omega(n^2). Karatsuba produced O(n^{1.58}) during Kolmogorov's seminar on the topic. Strassen discovered matrix multiplication is O(n^{2.81}) while trying to prove it is O(n^3). And on and on and on.
Maybe P and NP are well-formulated and they do perfectly capture our intuition of "efficient" and "efficiently verifiable" algorithms. Or maybe they don't. We are probably going to keep finding extremely weird, cheesed-out bounds for famous problems, though. You can choose what you want to believe, but I think it would be more remarkable if the reality of P and NP turned out to be as clean as the bounds indicate.
Comment by antics 1 day ago
Comment by calf 1 hour ago
It is true that CS had to make theoretical concessions. Just as Newton did. We don't criticize Newtonian mechanics (or, I don't know, Galileo?) for not being realistic about friction or idealized balls rolling down ramps. Their anti-empiricism was a starting point for physics.
To wit, the mathematical rationale for P-NP was precisely that that under polytime reduction this is still closed in P. That is a very reasonable starting point for a theory. This is also the reason why it is tripping up a large swath of the comment thread with people asking about subexponentials which do not preserve that closure
The opposite narrative is that in science, these idealizations yield profound intuitions and insights.
Furthermore, how far are you willing to go? Do you think Turing machines are invalid, that Turing-equivalent computation is pointless and unrealistic? So we are never allowed use that theory to convey the essential idea of in principle all computers being fundamentally functionally the same and that anything claimed to be more powerful than that had better have some incredible evidence, lest it be appeal to magic. Computability and complexity have a shared foundation so how much of that foundation are you going to reexamine?
Whereas if one wishes to be like a covert finitist/intuitionist, they ought to be open about that instead of accuse asymptotic complexity (or analgously, Turing computability as above) of trying to "cheese" complexity theory as a research programme. Meanwhile, it is true that P vs NP could have large exponents or constants in P, e.g. O(c*n^100...), literally this is the first thing taught in any complexity course or textbook. Students and practitioners remember this admonition well, maybe they just don't talk about it publicly as much.
One can go even further back. Cantor was marginalized for his ideas about infinities.
The difference with people like Lipton, and Knuth, is that the critique is coming from inside the house. In that they know the theory and the importance of it, but also hope/aspire for some new way to address the open question. They are keenly aware that P / NP is a problematic question, but not for lack of trying or stupidity on the part of other scientists. What is more likely is that the 21st/22nd century math to pose the better question does not exist yet (or may never be accessible to humans, another question well on the minds of many today).
Here's something to ponder. It is often observed that despite being NP-complete, many actual human instances are in fact tractable. E.g. routine airline scheduling depending on SAT solvers. But is this evidence that NP-completeness is a wrong theory or evidence that human-sized problems are a special case that becomes tractable (anthropocentrism), or some other more complicated reason?
Comment by cubefox 2 days ago
— Scott Aaronson
Comment by martin-t 1 day ago
With code, there's always plenty of bugs, hacks, quick "temporary" solutions, etc. But in math, a proof either exists or it doesn't and they can always be automatically verified using tools like Lean.
Comment by deadbabe 1 day ago
Comment by gf000 1 day ago
> 10^87 variables, a point where the proposed new method surpasses the already existing sat solvers
Yeah, it's not efficient in the ordinary sense.
Comment by silentmafia 1 day ago
Comment by colordrops 1 day ago
Comment by dgellow 1 day ago
Comment by thescobey 1 day ago
Comment by dachtovyvse 1 day ago
Comment by sevenzero 1 day ago
Comment by Kina 1 day ago
Comment by TZubiri 2 days ago
Considering that no human will be able to sift through these in no less than a team-decade, to verify that there's no mistake, yet still that will be massively less compute than the one necessary to produce the 'solution', isn't the empirical finding contrary to the theoretical finding being suggested? Namely that in practice we are generating these 'proofs' in a massive amount of compute time, but it will take tiny amounts of time to verify them.
Is it very useful to talk about computing in purely mathematical terms and not in empirical terms? There's very obvious truths that we are seeing here, and it seems like those that go through some sort of rigorous mathematical training kind of fail to see it. Similar to how 70% of physicians or something believe in the Many Worlds Interpretation or that time isn't real, a sort of algebraic psychosis where one is removed from a human reality that we have access to in order to attempt getting close to an 'objective reality' that is far removed from the human experience.
To some extent we are computing entities, so I don't even think that we can conceive of computing as decoupled from ourselves[1]. I know the observer effect is very often mis-cited by laymen, but I'll be damned if some computer scientists like Godel don't sound like they were up to something similar to this.
Also, here's another outsider perspective. This is obviously slop, I'm not sure how but it's obviously nerd-sniping the CS majors that understand this, because it's obviously very hard to find the flaw, but it gives epicycles energy. It's also sufficiently complex that under a bayesian analysis it is more likely that the AI has reached the limit of its processing power until it becomes confused enough to believe it has reached something significant, kind of like how I'm doing now.
[1] xkcd://1163
Comment by mattm 2 days ago
How do you figure that? For ETH, OpenAI is engaging with top experts in this area. It's unlikely that they'll need 10 man-years combined to go through the results:
> This work will be verified and shepherded by a group led by Russell Impagliazzo (UC San Diego), Ramamohan Paturi (UC San Diego), and Ryan Williams (MIT). All three are experts in algorithm design and complexity theory.
> Impagliazzo and Paturi, along with Francis Zane, are the original proposers of the Exponential Time Hypothesis, and have authored a number of influential papers on the topic over the last 30 years.
> Williams has refuted strong versions of the ETH, used ETH for hardness results, and connected algorithms and lower bounds.
Comment by TZubiri 2 days ago
Comment by jaekwon 2 days ago
Comment by zahlman 1 day ago
From the HN comment guidelines:
> Don't post generated text or AI-edited text. HN is for conversation between humans.
Disclosure doesn't address the objection (not that it wouldn't be obvious anyway). If you learned something from an AI convo, tell us what you learned, in your own words, not what the LLM said.
Comment by kevinwang 2 days ago
Comment by baggy_trough 2 days ago
Comment by elzbardico 2 days ago
It is not a demerit, actually I think that it is a very elegant outcome how many problems could be solved by generation and this probably show us how language is a far more important thing than we ever thought it was.
Comment by freecodeio 2 days ago
Comment by moishe_syzslak 2 days ago
Comment by eru 2 days ago
Comment by freecodeio 2 days ago
Comment by eru 2 days ago
They are making good progress on similar research programmes for many cetaceans.
In the case of our stochastic parrots it's even easier, since they already speak something like human language. And for the math proofs it's even easier, because once they are formalised into something like Lean the humans only need to understand the statement of the theorem, and a mechanical computer program can check the proof.
Comment by freecodeio 2 days ago
Comment by CaptWorld 2 days ago
Comment by freecodeio 1 day ago
Comment by aaron695 2 days ago
Comment by whattheheckheck 2 days ago
Comment by vecter 2 days ago
It's not possible for someone who's not a specialist in the field to understand it (unless there are more elementary proofs, of which likely none exist).
Comment by eru 2 days ago
Comment by xeonmc 2 days ago
siting on a recliner making an occasional sensible chuckle while flipping through the pages?
Comment by NetMageSCW 2 days ago
Comment by atlex2 2 days ago
Comment by elzbardico 2 days ago
Comment by paxy 2 days ago
Comment by whattheheckheck 2 days ago
Comment by serf 2 days ago
I totally disagree with you on the precept that all difficult to understand things need be needlessly dumbed-down/watered-down until palatable for a mass (average) audience. Requiring 'math50' before 'trig101' isn't gate-keeping in any moral sense, it's an effort to save everyones' time involved when the effort is futile.
Similarly I don't demand that haute couture fashion companies explain the style to me until 'I get it' ; I just take it for granted that i'm not going to be able to understand the entirety of the world in one lifetime.
Comment by eru 1 day ago
Why? The investors can just ask Claude or Gemini whether the proof holds up.
Comment by ks2048 2 days ago
OpenAI has that too - open their website and ask.
Comment by whattheheckheck 2 days ago