『Dwarkesh Podcast』のカバーアート

Dwarkesh Podcast

Dwarkesh Podcast

著者： D Patel
無料で聴く

概要

 Deeply researched interviews www.dwarkesh.comCopyright D Patel 科学
エピソード
  • Eric Jang – Building AlphaGo from scratch

    Eric Jang – Building AlphaGo from scratch
    2026/05/15
    Eric Jang walks through how to build AlphaGo from scratch, but with modern AI tools.Sometimes you understand the future better by stepping backward. AlphaGo is still the cleanest worked example of the primitives of intelligence: search, learning from experience, and self-play. You have to go back to 2017 to get insight on how the more general AIs of the future might learn.Once he explained how AlphaGo works, it gave us the context to have a discussion about how RL works in LLMs and how it could work better - naive policy gradient RL has to figure out which move in your 100s of k token trajectory actually caused resulted in you getting the right answer, while AlphaGo’s MCTS suggests a strictly better action every single move, giving you a training target that sidesteps the credit assignment problem. The way humans learn is surely closer to the second.Eric also kickstarted an Autoresearch loop on his project. And it was very interesting to discuss which parts of AI research LLMs can already automate pretty well (implementing and running experiments, optimizing hyperparameters) and which they still struggle with (choosing the right question to investigate next, escaping research dead ends). Informative to all the recent discussion about when we should expect an intelligence explosion, and what it would look like from the inside.Watch on YouTube. Read the transcript.Sponsors* Cursor‘s agent SDK let me build a pipeline to generate flashcards for this episode. For each card, I had an agent read the transcript, ingest blackboard screenshots, generate an SVG visual, and run everything through a critic. A durable agent is much better at this kind of work than a chain of LLM calls, and Cursor’s SDK made it easy. Check out the cards at flashcards.dwarkesh.com and get started with the SDK at cursor.com/dwarkesh* Jane Street gave me a real deep-dive tour of one of their datacenters. I got to ask a bunch of questions to Ron Minsky, who co-leads Jane Street’s tech group, and Dan Pontecorvo, who runs Jane Street’s physical engineering team. They were willing to literally pull up the floorboards and take out racks to explain how everything works. Check out the full tour at janestreet.com/dwarkeshTimestamps(00:00:00) – Basics of Go(00:08:17) – Monte Carlo Tree Search(00:32:04) – What the neural network does(01:00:33) – Self-play(01:25:38) – Alternative RL approaches(01:45:47) – Why doesn't MCTS work for LLMs(02:01:09) – Off-policy training(02:12:02) – RL is even more information inefficient than you thought(02:22:16) – Automated AI researchers

    Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
    続きを読む 一部表示
    2 時間 38 分
  • David Reich – Why the Bronze Age was an inflection point in human evolution

    David Reich – Why the Bronze Age was an inflection point in human evolution
    2026/05/08
    David Reich is back.He and collaborator Ali Akbari just published a paper that overturns a long-standing consensus about human evolution — that natural selection has been dormant in our species since the agricultural revolution.By scaling ancient DNA sequencing and developing a new statistical method, they found that selection has actually sped up.Selection went especially bonkers during the Bronze Age (around 3,000 years ago).That’s when gene frequencies for everything from immune function to body fat to intelligence were most in flux.Over the last 10,000 years, selection pushed the genetic predictor of cognitive performance up by roughly a full standard deviation — most of it between 4,000 and 2,000 years ago.After we finished recording, David sketched out on a whiteboard his new heretical model about who the Neanderthals really were. Luckily, I took out my iPhone and managed to record it.He thinks the standard story (that Neanderthals are some separate archaic lineage we interbred with a little) just doesn’t fit the evidence. Instead, he proposes that Neanderthals are essentially genetically-swamped modern humans.A small population somewhere around the Caucasus invented Middle Stone Age technology roughly 300,000 years ago and expanded outward. The ones that moved into Europe interbred with local archaic humans, got genetically swamped, and became Neanderthals. The same expansion went into Africa, met much more diverged archaic Africans, and that mixture became us.This means Neanderthals and modern humans share the same cultural ancestry — the only difference is which archaic humans they mixed with afterward.David is a brilliant and rigorous scholar. It was a real delight to learn from him again.Watch on YouTube; read the transcript.Sponsors* Cursor was super useful as I prepped for this episode. Whenever I had a question, I’d have Cursor kick off a few different models simultaneously and then compare their responses. I found that this led to better results than I could get out of any individual LLM. If you’ve only used Cursor for coding, you should try using it for research. Check it out at cursor.com/dwarkesh* Jane Street uses an internal currency called “hive bucks” to allocate compute through a real-time auction – and anyone can change anyone else’s bids or even kill their jobs! Everyone just trusts each other to act in the firm’s best interest, which is what lets the system work in the first place. If this weird and high-trust culture sounds like your kind of thing, Jane Street’s hiring at janestreet.com/dwarkesh* Crusoe’s ML infra team built fastokens, an open-source tokenizer that delivers a ~9x speedup over Hugging Face and up to 40% faster time-to-first token – on real production workloads! Crusoe achieved these results by parallelizing things and using some clever engineering to handle duplicates without cross-thread coordination. Learn more at crusoe.ai/dwarkeshTimestamps(00:00:00) – Ancient DNA suggests strong selection over last 10,000 years(00:15:45) – Natural selection intensified during the Bronze Age(00:35:02) – Why didn’t evolution max out intelligence?(00:57:21) – Evolution is limited by time, not population size(01:09:02) – Why no farming before the Ice Age?(01:17:13) – The Neanderthal puzzle David can’t stop thinking about(01:54:10) – The methodology behind this breakthrough Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
    続きを読む 一部表示
    2 時間 13 分
  • Elon Musk — "In 36 months, the cheapest place to put AI will be space”

    Elon Musk — "In 36 months, the cheapest place to put AI will be space”
    2026/05/05
    2 時間 50 分
adbl_web_anon_alc_button_suppression_c
まだレビューはありません