Strategic Implications of Openness in AI Development (2107)
Nick Bostrom. Future of Humanity Institute, University of Oxford.
Policy Implications
- The global desirability of openness in AI development – sharing e.g. source code, algorithms, or scientific insights – depends – on complex tradeoffs.
- A central concern is that openness could exacerbate a racing dynamic: competitors trying to be the first to develop advanced (superintelligent) AI may accept higher levels of existential risk in order to accelerate progress.
- Openness may reduce the probability of AI benefits being monopolized by a small group, but other potential political con- sequences are more problematic.
- Partial openness that enables outsiders to contribute to an AI project’s safety work and to supervise organizational plans and goals appears desirable.