Evolution
In discussions of AI risk, evolution is often used as an analogy/source of insights for the development of AGI. here are some examples:
- chimpanzee vs human intelligence
- optimization daemons/inner optimizers/mesa-optimization: organisms (including humans) are optimized for inclusive genetic fitness, but humans have come to value many different things (happiness, taste of food, love, curiosity, etc.), and these things can "come apart" (e.g. humans eating candy)
- the plausibility of AGI