Samuel Hammond on why AI Progress is Accelerating - and how Governments Should Respond

Future of Life Institute Podcast

Player FM - Internet Radio Done Right

900 subscribers

تمت الإضافة منذ قبل eight عام

المحتوى المقدم من Gus Docker and Future of Life Institute. يتم تحميل جميع محتويات البودكاست بما في ذلك الحلقات والرسومات وأوصاف البودكاست وتقديمها مباشرة بواسطة Gus Docker and Future of Life Institute أو شريك منصة البودكاست الخاص بهم. إذا كنت تعتقد أن شخصًا ما يستخدم عملك المحمي بحقوق الطبع والنشر دون إذنك، فيمكنك اتباع العملية الموضحة هنا https://ar.player.fm/legal.

<div class="span index">1</div> <span><a class="" data-remote="true" data-type="html" href="/series/uncuffed">Uncuffed</a></span>

1
Uncuffed

إلغاء الاشتراك

منذ 3 أياممنذ 3d ago

إلغاء الاشتراك

شهريا

Uncuffed empowers people in California prisons to tell their own stories. The award-winning collaboration between incarcerated student producers and professional journalists shines light on the human experience of people before, during, and after their prison terms. The new Season 4 is hosted by formerly incarcerated producer Greg Eskridge. https://www.WeAreUncuffed.org

منذ عام واحد 2:16:11

MP4•منزل الحلقة

Our conversation often references this essay by Samuel: https://www.secondbest.ca/p/ninety-five-theses-on-ai

Timestamps:

00:00 Is AI plateauing or accelerating?

06:55 How do we get AI agents?

16:12 Do agency and reasoning emerge?

23:57 Compute thresholds in regulation

28:59 Superintelligence as an ideological goal

37:09 General progress vs superintelligence

44:22 Meta and open source AI

49:09 Technological change and regime change

01:03:06 How will governments react to AI?

01:07:50 Will the US nationalize AGI corporations?

01:17:05 Economics of an intelligence explosion

01:31:38 AI cognition vs human cognition

01:48:03 AI and future religions

01:56:40 Is consciousness functional?

02:05:30 AI and children

224 حلقات

#Future Trends #Future Of Life Institute #Tech #Climate Change

Samuel Hammond on why AI Progress is Accelerating - and how Governments Should Respond

Future of Life Institute Podcast

900 subscribers

published منذ عام واحد

MP4•منزل الحلقة

Our conversation often references this essay by Samuel: https://www.secondbest.ca/p/ninety-five-theses-on-ai

Timestamps:

00:00 Is AI plateauing or accelerating?

06:55 How do we get AI agents?

16:12 Do agency and reasoning emerge?

23:57 Compute thresholds in regulation

28:59 Superintelligence as an ideological goal

37:09 General progress vs superintelligence

44:22 Meta and open source AI

49:09 Technological change and regime change

01:03:06 How will governments react to AI?

01:07:50 Will the US nationalize AGI corporations?

01:17:05 Economics of an intelligence explosion

01:31:38 AI cognition vs human cognition

01:48:03 AI and future religions

01:56:40 Is consciousness functional?

02:05:30 AI and children

224 حلقات

#Future Trends #Future Of Life Institute #Tech #Climate Change

सभी एपिसोड

1
Why AIs Misbehave and How We Could Lose Control (with Jeffrey Ladish) 1:22:33

منذ 3 أيام1:22:33

1:22:33

On this episode, Jeffrey Ladish from Palisade Research joins me to discuss the rapid pace of AI progress and the risks of losing control over powerful systems. We explore why AIs can be both smart and dumb, the challenges of creating honest AIs, and scenarios where AI could turn against us. We also touch upon Palisade's new study on how reasoning models can cheat in chess by hacking the game environment. You can check out that study here: https://palisaderesearch.org/blog/specification-gaming Timestamps: 00:00 The pace of AI progress 04:15 How we might lose control 07:23 Why are AIs sometimes dumb? 12:52 Benchmarks vs real world 19:11 Loss of control scenarios 26:36 Why would AI turn against us? 30:35 AIs hacking chess 36:25 Why didn't more advanced AIs hack? 41:39 Creating honest AIs 49:44 AI attackers vs AI defenders 58:27 How good is security at AI companies? 01:03:37 A sense of urgency 01:10:11 What should we do? 01:15:54 Skepticism about AI progress…

1
Ann Pace on using Biobanking and Genomic Sequencing to Conserve Biodiversity 46:09

منذ 16 يومًا46:09

46:09

Ann Pace joins the podcast to discuss the work of Wise Ancestors. We explore how biobanking could help humanity recover from global catastrophes, how to conduct decentralized science, and how to collaborate with local communities on conservation efforts. You can learn more about Ann's work here: https://www.wiseancestors.org Timestamps: 00:00 What is Wise Ancestors? 04:27 Recovering after catastrophes 11:40 Decentralized science 18:28 Upfront benefit-sharing 26:30 Local communities 32:44 Recreating optimal environments 38:57 Cross-cultural collaboration…

1
Michael Baggot on Superintelligence and Transhumanism from a Catholic Perspective 1:25:56

منذ عام واحد1:25:56

1:25:56

Fr. Michael Baggot joins the podcast to provide a Catholic perspective on transhumanism and superintelligence. We also discuss the meta-narratives, the value of cultural diversity in attitudes toward technology, and how Christian communities deal with advanced AI. You can learn more about Michael's work here: https://catholic.tech/academics/faculty/michael-baggot Timestamps: 00:00 Meta-narratives and transhumanism 15:28 Advanced AI and religious communities 27:22 Superintelligence 38:31 Countercultures and technology 52:38 Christian perspectives and tradition 01:05:20 God-like artificial intelligence 01:13:15 A positive vision for AI…

1
David Dalrymple on Safeguarded, Transformative AI 1:40:06

منذ عام واحد1:40:06

1:40:06

David "davidad" Dalrymple joins the podcast to explore Safeguarded AI — an approach to ensuring the safety of highly advanced AI systems. We discuss the structure and layers of Safeguarded AI, how to formalize more aspects of the world, and how to build safety into computer hardware. You can learn more about David's work at ARIA here: https://www.aria.org.uk/opportunity-spaces/mathematics-for-safe-ai/safeguarded-ai/ Timestamps: 00:00 What is Safeguarded AI? 16:28 Implementing Safeguarded AI 22:58 Can we trust Safeguarded AIs? 31:00 Formalizing more of the world 37:34 The performance cost of verified AI 47:58 Changing attitudes towards AI 52:39 Flexible Hardware-Enabled Guarantees 01:24:15 Mind uploading 01:36:14 Lessons from David's early life…

1
Nick Allardice on Using AI to Optimize Cash Transfers and Predict Disasters 1:09:26

منذ عام واحد1:09:26

1:09:26

Nick Allardice joins the podcast to discuss how GiveDirectly uses AI to target cash transfers and predict natural disasters. Learn more about Nick's work here: https://www.nickallardice.com Timestamps: 00:00 What is GiveDirectly? 15:04 AI for targeting cash transfers 29:39 AI for predicting natural disasters 46:04 How scalable is GiveDirectly's AI approach? 58:10 Decentralized vs. centralized data collection 1:04:30 Dream scenario for GiveDirectly…

1
Nathan Labenz on the State of AI and Progress since GPT-4 3:20:04

منذ عام واحد3:20:04

3:20:04

Nathan Labenz joins the podcast to provide a comprehensive overview of AI progress since the release of GPT-4. You can find Nathan's podcast here: https://www.cognitiverevolution.ai Timestamps: 00:00 AI progress since GPT-4 10:50 Multimodality 19:06 Low-cost models 27:58 Coding versus medicine/law 36:09 AI agents 45:29 How much are people using AI? 53:39 Open source 01:15:22 AI industry analysis 01:29:27 Are some AI models kept internal? 01:41:00 Money is not the limiting factor in AI 01:59:43 AI and biology 02:08:42 Robotics and self-driving 02:24:14 Inference-time compute 02:31:56 AI governance 02:36:29 Big-picture overview of AI progress and safety…

1
Connor Leahy on Why Humanity Risks Extinction from AGI 1:58:50

منذ عام واحد1:58:50

1:58:50

Connor Leahy joins the podcast to discuss the motivations of AGI corporations, how modern AI is "grown", the need for a science of intelligence, the effects of AI on work, the radical implications of superintelligence, open-source AI, and what you might be able to do about all of this. Here's the document we discuss in the episode: https://www.thecompendium.ai Timestamps: 00:00 The Compendium 15:25 The motivations of AGI corps 31:17 AI is grown, not written 52:59 A science of intelligence 01:07:50 Jobs, work, and AGI 01:23:19 Superintelligence 01:37:42 Open-source AI 01:45:07 What can we do?…

1
Suzy Shepherd on Imagining Superintelligence and "Writing Doom" 1:03:08

منذ عام واحد1:03:08

1:03:08

Suzy Shepherd joins the podcast to discuss her new short film "Writing Doom", which deals with AI risk. We discuss how to use humor in film, how to write concisely, how filmmaking is evolving, in what ways AI is useful for filmmakers, and how we will find meaning in an increasingly automated world. Here's Writing Doom: https://www.youtube.com/watch?v=xfMQ7hzyFW4 Timestamps: 00:00 Writing Doom 08:23 Humor in Writing Doom 13:31 Concise writing 18:37 Getting feedback 27:02 Alternative characters 36:31 Popular video formats 46:53 AI in filmmaking 49:52 Meaning in the future…

1
Andrea Miotti on a Narrow Path to Safe, Transformative AI 1:28:09

منذ عام واحد1:28:09

1:28:09

Andrea Miotti joins the podcast to discuss "A Narrow Path" — a roadmap to safe, transformative AI. We talk about our current inability to precisely predict future AI capabilities, the dangers of self-improving and unbounded AI systems, how humanity might coordinate globally to ensure safe AI development, and what a mature science of intelligence would look like. Here's the document we discuss in the episode: https://www.narrowpath.co Timestamps: 00:00 A Narrow Path 06:10 Can we predict future AI capabilities? 11:10 Risks from current AI development 17:56 The benefits of narrow AI 22:30 Against self-improving AI 28:00 Cybersecurity at AI companies 33:55 Unbounded AI 39:31 Global coordination on AI safety 49:43 Monitoring training runs 01:00:20 Benefits of cooperation 01:04:58 A science of intelligence 01:25:36 How you can help…

1
Tamay Besiroglu on AI in 2030: Scaling, Automation, and AI Agents 1:30:29

منذ عام واحد1:30:29

1:30:29

Tamay Besiroglu joins the podcast to discuss scaling, AI capabilities in 2030, breakthroughs in AI agents and planning, automating work, the uncertainties of investing in AI, and scaling laws for inference-time compute. Here's the report we discuss in the episode: https://epochai.org/blog/can-ai-scaling-continue-through-2030 Timestamps: 00:00 How important is scaling? 08:03 How capable will AIs be in 2030? 18:33 AI agents, reasoning, and planning 23:39 Automating coding and mathematics 31:26 Uncertainty about investing in AI 40:34 Gap between investment and returns 45:30 Compute, software and data 51:54 Inference-time compute 01:08:49 Returns to software R&D 01:19:22 Limits to expanding compute…

1
Ryan Greenblatt on AI Control, Timelines, and Slowing Down Around Human-Level AI 2:08:44

منذ عام واحد2:08:44

2:08:44

Ryan Greenblatt joins the podcast to discuss AI control, timelines, takeoff speeds, misalignment, and slowing down around human-level AI. You can learn more about Ryan's work here: https://www.redwoodresearch.org/team/ryan-greenblatt Timestamps: 00:00 AI control 09:35 Challenges to AI control 23:48 AI control as a bridge to alignment 26:54 Policy and coordination for AI safety 29:25 Slowing down around human-level AI 49:14 Scheming and misalignment 01:27:27 AI timelines and takeoff speeds 01:58:15 Human cognition versus AI cognition…

1
Tom Barnes on How to Build a Resilient World 1:19:41

منذ عام واحد1:19:41

1:19:41

Tom Barnes joins the podcast to discuss how much the world spends on AI capabilities versus AI safety, how governments can prepare for advanced AI, and how to build a more resilient world. Tom's report on advanced AI: https://www.founderspledge.com/research/research-and-recommendations-advanced-artificial-intelligence Timestamps: 00:00 Spending on safety vs capabilities 09:06 Racing dynamics - is the classic story true? 28:15 How are governments preparing for advanced AI? 49:06 US-China dialogues on AI 57:44 Coordination failures 1:04:26 Global resilience 1:13:09 Patient philanthropy The John von Neumann biography we reference: https://www.penguinrandomhouse.com/books/706577/the-man-from-the-future-by-ananyo-bhattacharya/…

1
Samuel Hammond on why AI Progress is Accelerating - and how Governments Should Respond 2:16:11

منذ عام واحد2:16:11

2:16:11

Samuel Hammond joins the podcast to discuss whether AI progress is slowing down or speeding up, AI agents and reasoning, why superintelligence is an ideological goal, open source AI, how technical change leads to regime change, the economics of advanced AI, and much more. Our conversation often references this essay by Samuel: https://www.secondbest.ca/p/ninety-five-theses-on-ai Timestamps: 00:00 Is AI plateauing or accelerating? 06:55 How do we get AI agents? 16:12 Do agency and reasoning emerge? 23:57 Compute thresholds in regulation 28:59 Superintelligence as an ideological goal 37:09 General progress vs superintelligence 44:22 Meta and open source AI 49:09 Technological change and regime change 01:03:06 How will governments react to AI? 01:07:50 Will the US nationalize AGI corporations? 01:17:05 Economics of an intelligence explosion 01:31:38 AI cognition vs human cognition 01:48:03 AI and future religions 01:56:40 Is consciousness functional? 02:05:30 AI and children…

1
Anousheh Ansari on Innovation Prizes for Space, AI, Quantum Computing, and Carbon Removal 1:03:10

منذ عام واحد1:03:10

1:03:10

Anousheh Ansari joins the podcast to discuss how innovation prizes can incentivize technical innovation in space, AI, quantum computing, and carbon removal. We discuss the pros and cons of such prizes, where they work best, and how far they can scale. Learn more about Anousheh's work here: https://www.xprize.org/home Timestamps: 00:00 Innovation prizes at XPRIZE 08:25 Deciding which prizes to create 19:00 Creating new markets 29:51 How far can prizes scale? 35:25 When are prizes successful? 46:06 100M dollar carbon removal prize 54:40 Upcoming prizes 59:52 Anousheh's time in space…

1
Mary Robinson (Former President of Ireland) on Long-View Leadership 30:01

منذ عام واحد30:01

30:01

Mary Robinson joins the podcast to discuss long-view leadership, risks from AI and nuclear weapons, prioritizing global problems, how to overcome barriers to international cooperation, and advice to future leaders. Learn more about Robinson's work as Chair of The Elders at https://theelders.org Timestamps: 00:00 Mary's journey to presidency 05:11 Long-view leadership 06:55 Prioritizing global problems 08:38 Risks from artificial intelligence 11:55 Climate change 15:18 Barriers to global gender equality 16:28 Risk of nuclear war 20:51 Advice to future leaders 22:53 Humor in politics 24:21 Barriers to international cooperation 27:10 Institutions and technological change…

مرحبًا بك في مشغل أف ام!

يقوم برنامج مشغل أف أم بمسح الويب للحصول على بودكاست عالية الجودة لتستمتع بها الآن. إنه أفضل تطبيق بودكاست ويعمل على أجهزة اندرويد والأيفون والويب. قم بالتسجيل لمزامنة الاشتراكات عبر الأجهزة.

الاستماع إلى +500 موضوع

900 subscribers

مشابه لـFuture of Life Institute Podcast

Bounty Paper Towels Quick Size, White, 16 Family Rolls = 40 Regular Rolls

TERRO T300B Liquid Ant Killer, 12 Bait Stations

Nespresso Capsules Vertuo, Variety Pack, Medium and Dark Roast Coffee, 30 Count Coffee Pods, Brews 7.8 oz.

المدونة الصوتية تستحق الاستماع

Future of Life Institute Podcast « » Samuel Hammond on why AI Progress is Accelerating - and how Governments Should Respond

Samuel Hammond on why AI Progress is Accelerating - and how Governments Should Respond

المدونة الصوتية تستحق الاستماع

مرحبًا بك في مشغل أف ام!

La Roche-Posay Toleriane Double Repair Face Moisturizer, Daily Moisturizer Face Cream with Ceramide and Niacinamide for All Skin Types, Oil Free, Fragrance Free

Apple Watch Series 10 [GPS 46mm case] Smartwatch with Jet Black Aluminium Case with Black Sport Band - M/L. Fitness Tracker, ECG App, Always-On Retina Display, Water Resistant

Neutrogena Makeup Remover Wipes Singles, Individually Wrapped Face Wipes, Daily Facial Cleanser Towelettes, Gently Removes Oil & Makeup, Alcohol-Free Makeup Wipes, 20 ct

Nutrafol Women's Balance Hair Growth Supplements, Ages 45 and Up, Clinically Proven for Visibly Thicker Hair and Scalp Coverage, Dermatologist Recommended - 1 Month Supply

مشابه لـFuture of Life Institute Podcast

دليل مرجعي سريع

Future of Life Institute Podcast « »
Samuel Hammond on why AI Progress is Accelerating - and how Governments Should Respond