Late singularity - Revision history

Issa at 21:33, 4 April 2021

2021-04-04T21:33:39Z

Issa at 02:26, 10 March 2020

2020-03-10T02:26:34Z

Issa at 00:58, 10 March 2020

2020-03-10T00:58:21Z

Issa: Created page with "here "late singularity" means something like "the singularity happens 200+ years from now, rather than like 20 years or 100 years". are late singularities actually better? if..."

2020-03-10T00:46:00Z

Created page with "here "late singularity" means something like "the singularity happens 200+ years from now, rather than like 20 years or 100 years". are late singularities actually better? if..."

New page

here "late singularity" means something like "the singularity happens 200+ years from now, rather than like 20 years or 100 years".

are late singularities actually better? if AGI is developed in 200 years, what does this say about ai xrisk? this could happen for several reasons:

# making AGI turned out to be much harder than we thought -- i think if you have the intuition that "ai safety will be much harder than building agi", then this might push you to think "ai safety is basically impossible for humans without intelligence enhancement to solve".
# our institutions turned out to be much suckier than we thought (e.g. all of AI academia and for-profit company labs just Great Stagnate) -- this seems bad from an xrisk standpoint, because it means we're probably just super bad at coordinating, so we can't even solve ai safety.
# on the other hand, maybe this means we just get a lot more time to get together and work on ai safety.
# couldn't this also mean that we are super ''good'' at coordination, and we were able to slow down AI progress?

← Older revision		Revision as of 21:33, 4 April 2021
Line 10:		Line 10:

	in other words, finding P(doom \| AGI after 2220) seems tricky to figure out, since there could be multiple reasons for why AGI happens after 2220, and each thing says something pretty different about probability of doom.		in other words, finding P(doom \| AGI after 2220) seems tricky to figure out, since there could be multiple reasons for why AGI happens after 2220, and each thing says something pretty different about probability of doom.
		+
		+	[[Category:AI safety]]

← Older revision		Revision as of 00:58, 10 March 2020
Line 7:		Line 7:
	# on the other hand, maybe this means we just get a lot more time to get together and work on ai safety.		# on the other hand, maybe this means we just get a lot more time to get together and work on ai safety.
	# couldn't this also mean that we are super ''good'' at coordination, and we were able to slow down AI progress?		# couldn't this also mean that we are super ''good'' at coordination, and we were able to slow down AI progress?
		+
		+	in other words, finding P(doom \| AGI after 2220) seems tricky to figure out, since there could be multiple reasons for why AGI happens after 2220, and each thing says something pretty different about probability of doom.

@@ Line 7: / Line 7: @@
 # on the other hand, maybe this means we just get a lot more time to get together and work on ai safety.
 # couldn't this also mean that we are super ''good'' at coordination, and we were able to slow down AI progress?
 in other words, finding P(doom | AGI after 2220) seems tricky to figure out, since there could be multiple reasons for why AGI happens after 2220, and each thing says something pretty different about probability of doom.