FOR EDUCATIONAL AND KNOWLEDGE SHARING PURPOSES ONLY. NOT-FOR-PROFIT. SEE COPYRIGHT DISCLAIMER.

What Is AI Distillation — And How DeepSeek Used It To Blindside OpenAI | CNBC

21 Feb 2025. Silicon Valley is now reckoning with a technique in AI development that could upend the leaderboard. Distillation is the idea that a small team with virtually no resources can make an advanced AI model by extracting knowledge from a larger one. While the Chinese AI startup DeepSeek didn’t invent the method, its use of the technique roiled the stock market and woke the AI world up to its disruptive potential. Distillation is now enabling less-capitalized startups and research labs to compete at the cutting edge faster than ever before. DeepSeek’s breakthroughs also ushered in the rise of a new open-source order, based on a belief that transparency and accessibility drive innovation faster than closed-door research. That combination — distillation’s newfound traction and open-source’s rise in popularity — is deadly for the competitive edges that the biggest AI players had. This video also includes Bosa’s full interview with Glean CEO Arvind Jain. Chapters: 00:00 Introduction 01:03 Chapter 1: Distill and conquer 06:47 Chapter 2: A new open-source era 10:05 Chapter 3: AGI at all costs 12:47 Chapter 4: Glean CEO interview

FOR EDUCATIONAL AND KNOWLEDGE SHARING PURPOSES ONLY. NOT-FOR-PROFIT. SEE COPYRIGHT DISCLAIMER.