Page
ReadView sourceView history

Goalpost for usefulness of HRAD work

From Issawiki (static archive)

When thinking about the question of "How useful is HRAD work?", what standards/goalposts should we use? There's a pattern I see where:

It seems like there's a question of what is the relevant goalpost, for deciding whether HRAD work is useful.

This is an example of what I mean, when I say that the goalpost is set at an easier spot by MIRI: "Techniques you can actually adapt in a safe AI, come the day, will probably have very simple cores — the sort of core concept that takes up three paragraphs, where any reviewer who didn’t spend five years struggling on the problem themselves will think, “Oh I could have thought of that.” Someday there may be a book full of clever and difficult things to say about the simple core — contrast the simplicity of the core concept of causal models, versus the complexity of proving all the clever things Judea Pearl had to say about causal models. But the planetary benefit is mainly from posing understandable problems crisply enough so that people can see they are open, and then from the simpler abstract properties of a found solution — complicated aspects will not carry over to real AIs later." [1]

In contrast, the kind of goalpost Daniel Dewey sets in [2] seems much harder/more restrictive.


See also

External links