Difference between revisions of "Progress in self-improvement"
| Line 4: | Line 4: | ||
"before we have AI that radically accelerates AI development, the slow takeoff argument suggests we will have AI that ''significantly'' accelerates AI development (and before that, ''slightly'' accelerates development). That is, an AI is just another, faster step in the hyperbolic growth we are currently experiencing, which corresponds to a further increase in rate but not a discontinuity (or even a discontinuity in rate)."<ref>https://sideways-view.com/2018/02/24/takeoff-speeds/</ref> | "before we have AI that radically accelerates AI development, the slow takeoff argument suggests we will have AI that ''significantly'' accelerates AI development (and before that, ''slightly'' accelerates development). That is, an AI is just another, faster step in the hyperbolic growth we are currently experiencing, which corresponds to a further increase in rate but not a discontinuity (or even a discontinuity in rate)."<ref>https://sideways-view.com/2018/02/24/takeoff-speeds/</ref> | ||
| + | |||
| + | "Eliezer seems to have, and this page seems to reflect, strong intuitions about "self-modification" beyond what you would expect from synonymy with "AI systems doing AI design and implementation." In my view of the world, there is no meaningful distinction between these things, and this post sounds confused. I think it would be worth pushing more on this divergence."<ref>https://arbital.com/p/KANSI/</ref> | ||
==See also== | ==See also== | ||
Revision as of 16:48, 24 June 2020
"Also an AI which recursively improves itself forever will probably be preceded by AIs which self improve to a lesser extent, so the field will be moving fast already."[1]
"If you take the self-improving software – of course, we have software that self improves, it just does a lousy job of it. If you imagine steady improvement in the self-improvement, that doesn't give a local team a strong advantage. You have to imagine that there's some clever insight that gives a local team a vast, cosmically vast, advantage in its ability to self-improve compared to the other teams such that not only can it self improve, but it self improves like gangbusters in a very short time."[2]
"before we have AI that radically accelerates AI development, the slow takeoff argument suggests we will have AI that significantly accelerates AI development (and before that, slightly accelerates development). That is, an AI is just another, faster step in the hyperbolic growth we are currently experiencing, which corresponds to a further increase in rate but not a discontinuity (or even a discontinuity in rate)."[3]
"Eliezer seems to have, and this page seems to reflect, strong intuitions about "self-modification" beyond what you would expect from synonymy with "AI systems doing AI design and implementation." In my view of the world, there is no meaningful distinction between these things, and this post sounds confused. I think it would be worth pushing more on this divergence."[4]
