Superintelligence: paths, dangers, strategies

Swedish philosopher Nick Bostrom began thinking of a future full of human enhancement, nanotechnology and cloning long before they became mainstream concerns. Bostrom approaches both the inevitable and the speculative using the tools of philosophy, bioethics and probability.

Nick is Professor in the Faculty of Philosophy at Oxford University and founding Director of the Future of Humanity Institute and of the Programme on the Impacts of Future Technology within the Oxford Martin School. He's also the co-founder and chair of both the World Transhumanist Association, which advocates the use of technology to extend human capabilities and lifespans, and the Institute for Ethics and Emerging Technologies.

====

Professor Nick Bostrom, Director, Oxford Martin Programme on the Impacts of Future Technologies

Join Professor Nick Bostrom for a talk on his new book, Superintelligence: Paths, Dangers, Strategies, and for a journey that takes us to the frontiers of thinking about the human condition and the future of intelligent life.

The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains.

If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of our species then would come to depend on the actions of the machine superintelligence.

But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation?

====

Superintelligence asks the questions: What happens when machines surpass humans in general intelligence? Will artificial agents save or destroy us? Nick Bostrom lays the foundation for understanding the future of humanity and intelligent life.

The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. If machine brains surpassed human brains in general intelligence, then this new superintelligence could become extremely powerful - possibly beyond our control. As the fate of the gorillas now depends more on humans than on the species itself, so would the fate of humankind depend on the actions of the machine superintelligence.

But we have one advantage: we get to make the first move. Will it be possible to construct a seed Artificial Intelligence, to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation?

This profoundly ambitious and original book breaks down a vast track of difficult intellectual terrain. After an utterly engrossing journey that takes us to the frontiers of thinking about the human condition and the future of intelligent life, we find in Nick Bostrom's work nothing less than a reconceptualization of the essential task of our time.

====

Elon Musk and other panellists talk AI and answer the question: “If we succeed in building human-level Artificial general intelligence (AGI), then what are the likely outcomes? What would we like to happen?”

Credit: Thanks to the Future of Life Institute for sharing. Visit their website at: https://futureoflife.org
Thanks to fan-of-the-channel Alan for the heads up!

Overview:
00:00. Yes, No, It’s complicated
03:10. Timescale (Elon at 5:45)
07:07. How to slow it down
14:04. Risks and mitigations (Elon at 32:14)
37:00. Upsides (Elon at 51:18)
Q&A
52:44. Democracy 2.0
54:14. Bad guys
56:43. Democratising AI (Elon)

Panelists: Bart Selman (Cornell), David Chalmers (NYU), Elon Musk (Tesla, SpaceX), Jaan Tallinn (CSER/FLI), Nick Bostrom (FHI), Ray Kurzweil (Google), Stuart Russell (Berkeley), Sam Harris, Demis Hassabis (DeepMind).

=====

Искусственный интеллект становится умнее не по дням, а по часам. Исследования показывают, что в течение этого столетия ИИ может стать таким же «умным», как и человек. Ник Бостром говорит: «ИИ обгонит нас. Машинный интеллект — самое последнее изобретение, которое человечеству когда-либо придётся создать». Философ и технолог, Бостром просит нас хорошенько подумать о мире, управляемом мыслящими машинами, о мире, который мы сейчас создаём. Будут ли умные машины помогать человечеству и нашим ценностям или же у них будут свои ценности?

======

Ник Бостром. Сколько осталось до суперинтеллекта?

«Искусственный интеллект. Этапы. Угрозы. Стратегии» Ник Бостром