Difference between revisions of "Evolution"
m (Issa moved page Evolution analogy to Evolution) |
|||
| Line 1: | Line 1: | ||
| − | In discussions of AI risk, evolution is often used as an analogy for the development of AGI. here are some examples: | + | In discussions of AI risk, evolution is often used as an analogy/source of insights for the development of AGI. here are some examples: |
* chimpanzee vs human intelligence | * chimpanzee vs human intelligence | ||
| − | * [[optimization daemon]]s/inner optimizers/mesa-optimization | + | * [[optimization daemon]]s/inner optimizers/mesa-optimization: organisms (including humans) are optimized for inclusive genetic fitness, but humans have come to value many different things (happiness, taste of food, love, curiosity, etc.), and these things can "come apart" (e.g. humans eating candy) |
* the plausibility of AGI | * the plausibility of AGI | ||
Revision as of 23:28, 22 February 2020
In discussions of AI risk, evolution is often used as an analogy/source of insights for the development of AGI. here are some examples:
- chimpanzee vs human intelligence
- optimization daemons/inner optimizers/mesa-optimization: organisms (including humans) are optimized for inclusive genetic fitness, but humans have come to value many different things (happiness, taste of food, love, curiosity, etc.), and these things can "come apart" (e.g. humans eating candy)
- the plausibility of AGI
