These companies OpenAI, Anthropic, Google Deep Mind, some of these other companies as well, they are racing to build super intelligence. Um you can see this on their website and in the statements of the CEOs. um especially OpenAI and Anthropic have been pretty um have been pretty have have literally said that they are building super intelligence um and they’re trying to build it that they think they will succeed um around the end of this decade or before this decade is out. What is super intelligence? Super intelligence is an AI system that is better than the best humans at everything while also being faster and cheaper. So if they succeed in getting to super intelligence then the alignment problem suddenly becomes extremely high stakes. We need to make sure that any super intelligences that are built or at least the first ones that are built are aligned. Mhm. Otherwise terrible things could happen such as human extinction. — Daniel Kokatajlo (06:52)