Generative AI 101: Tokens, Pre-training, Fine-tuning, Reasoning — With Dylan Patel
Big Technology Podcast
04/23/25
•41m
About
Comments
Featured In
Dylan Patel is the founder and CEO of SemiAnalysis. He joins Big Technology Podcast to explain how generative AI work, explaining the inner workings of tokens, pre-training, fine-tuning, open source, and reasoning. We also cover DeepSeek’s efficiency breakthrough, the race to build colossal AI data centers, and what GPT-5’s hybrid training approach could unlock. Hit play for a masterclass you’ll want to send to every friend puzzled (or excited) about the future of AI.
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology
Questions? Feedback? Write to: bigtechnologypodcast@gmail.com
Learn more about your ad choices. Visit megaphone.fm/adchoices
Previous Episode
Ranjan Roy from Margins is back for our weekly discussion of the latest tech news. We cover 1) Is OpenAI's o3 model AGI? 2) Maybe it's AGI when you squint 3) Why people are floating the idea that OpenAi is close to AGI 4) Is OpenAI going to declare that GPT-5 is AGI 5) What's in it for companies saying they've achieved AGI first? 6) AI's new memory capabilities add something big to the experience 7) Is AI the new social media? 8) Facebook has moved away from friend sharing 9) Could Google be broken up? 10) Is Google's stake in the open web actually a good thing?
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
For weekly updates on the show, sign up for the pod newsletter on LinkedIn: https://www.linkedin.com/newsletters/6901970121829801984/
Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology
Questions? Feedback? Write to: bigtechnologypodcast@gmail.com
Learn more about your ad choices. Visit megaphone.fm/adchoices
Next Episode
Ranjan Roy from Margins is back for our weekly discussion of the latest tech news. We cover 1) Anthropic researcher's assertion that there's a 15% chance Claude is conscious 2) What happens if people believe AI is sentient? 3) Why consciousness and intelligence are different 4) Hey, is this all just marketing? 5) Anthropic CEO Dario Amodei's push for AI model interpretability 6) China's robot half-marathon 7) Tesla's wild earnings week 8) Why Google is thriving despite the ChatGPT threat 9) Are we going to shop directly within ChatGPT? 10) Kevin Systrom's flawed testimony against Facebook 11) Washington DC thinks Big Tech is getting broken up.
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
Want a discount for Big Technology on Substack? Here’s 25% off for the first year: https://www.bigtechnology.com/subscribe?coupon=0843016b
Questions? Feedback? Write to: bigtechnologypodcast@gmail.com
Learn more about your ad choices. Visit megaphone.fm/adchoices
If you like this episode you’ll love
Promoted