Search a title or topic

Over 20 million podcasts, powered by 

Player FM logo
Artwork

Content provided by Fin Moorhouse and Luca Righetti, Fin Moorhouse, and Luca Righetti. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Fin Moorhouse and Luca Righetti, Fin Moorhouse, and Luca Righetti or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.
Player FM - Podcast App
Go offline with the Player FM app!

#65 – Katja Grace on Slowing Down AI and Whether the X-Risk Case Holds Up

1:43:43
 
Share
 

Manage episode 365707489 series 2607952
Content provided by Fin Moorhouse and Luca Righetti, Fin Moorhouse, and Luca Righetti. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Fin Moorhouse and Luca Righetti, Fin Moorhouse, and Luca Righetti or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.

Katja Grace is a researcher and writer. She runs AI Impacts, a research project trying to incrementally answer decision-relevant questions about the future of artificial intelligence (AI). Katja blogs primarily at worldspiritsockpuppet, and indirectly at Meteuphoric, Worldly Positions, LessWrong and the EA Forum.

We discuss:

  • What is AI Impacts working on?
  • Counterarguments to the basic AI x-risk case
  • Reasons to doubt that superhuman AI systems will be strongly goal-directed
  • Reasons to doubt that if goal-directed superhuman AI systems are built, their goals will be bad by human lights
  • Aren't deep learning systems fairly good at understanding our 'true' intentions?
  • Reasons to doubt that (misaligned) superhuman AI would overpower humanity
  • The case for slowing down AI
  • Is AI really an arms race?
  • Are there examples from history of valuable technologies being limited or slowed down?
  • What does Katja think about the recent open letter on pausing giant AI experiments?
  • Why read George Saunders?

Key links:

You can see more links and a full transcript at hearthisidea.com/episodes/grace.

  continue reading

90 episodes

Artwork
iconShare
 
Manage episode 365707489 series 2607952
Content provided by Fin Moorhouse and Luca Righetti, Fin Moorhouse, and Luca Righetti. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Fin Moorhouse and Luca Righetti, Fin Moorhouse, and Luca Righetti or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.

Katja Grace is a researcher and writer. She runs AI Impacts, a research project trying to incrementally answer decision-relevant questions about the future of artificial intelligence (AI). Katja blogs primarily at worldspiritsockpuppet, and indirectly at Meteuphoric, Worldly Positions, LessWrong and the EA Forum.

We discuss:

  • What is AI Impacts working on?
  • Counterarguments to the basic AI x-risk case
  • Reasons to doubt that superhuman AI systems will be strongly goal-directed
  • Reasons to doubt that if goal-directed superhuman AI systems are built, their goals will be bad by human lights
  • Aren't deep learning systems fairly good at understanding our 'true' intentions?
  • Reasons to doubt that (misaligned) superhuman AI would overpower humanity
  • The case for slowing down AI
  • Is AI really an arms race?
  • Are there examples from history of valuable technologies being limited or slowed down?
  • What does Katja think about the recent open letter on pausing giant AI experiments?
  • Why read George Saunders?

Key links:

You can see more links and a full transcript at hearthisidea.com/episodes/grace.

  continue reading

90 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Copyright 2025 | Privacy Policy | Terms of Service | | Copyright
Listen to this show while you explore
Play