Reddit reviews Our Final Invention
We found 6 Reddit comments about Our Final Invention. Here are the top ones, ranked by their Reddit score.
Our Final Invention Artificial Intelligence and the End of the Human Era
Check out Our Final Invnetion by James Barrat; if we're lucky, the difference between the first artificial general intelligence and the first artificial general superintelligence will be a few hours at most. Exponential growth is a bitch.
The most obvious answer is Bostrom's Superintelligence, and you can indeed find more info on this whole topic on /r/ControlProblem. (So basically I agree 100% with /u/Colt85.)
The other book closest to what you're asking for is probably Roman Yampolskiy's Artificial Superintelligence: A Futuristic Approach (2015). I would also recommend his and Kaj Sotala's 2014 Responses to catastrophic AGI risk: a survey, which isn't a book, but does provide a great overview.
Wendell Wallach & Colin Allen's Moral Machines: Teaching Robots Right from Wrong (2010) does talk about methods, but is not necessarily about superintelligence. There are also some books about the dangers of superintelligence that don't necessarily say what to do about it: 1) Stuart Armstrong's Smarter Than Us: The Rise of Machine Intelligence (2014), 2) James Barrat's Our Final Invention: Artificial Intelligence and the End of the Human Era (2015), and 3) Murray Shanahan's The Technological Singularity (2015). And probably many more... but these are the most relevant ones I know of.
Our rate of technological advancement is getting to a very interesting point in it's exponential rate increase. We're on the cusp of technologies that will radically change the world damn near overnight.
On the one hand, we are getting absurdly close to sustainable fusion; hell, skunkworks said 2(?) years ago that they would have a working prototype in 5 years and a production model in 10. Anyone else, yeah, it's been said for decades by dozens, but Skunkworks? These are the people that were tasked with coming up with an aircraft that had a 40(?)% smaller than actual radar cross section and showed up with a basically invisible plane. Absurdly cheap, plentiful, portable energy like their proposed reactor design will change everything from CO2 emissions to clean/fresh water availability.
On the other hand..
I'm cautiously optimistic about AI, but there are a stupid amount of ways that AI development could go wrong, and it's unlike anything humanity has developed before. Nukes? Yeah, very.. VERY destructive invention, but it only took two actual uses before humanity as a whole stepped back and said, "Waaaaait a minute. Yeah, we should probably not ever do this again." The thing with AI is that if someone fucks up once, it could very well be game over almost literally overnight.
And those are just the things we know about. For all I know, some dufus is in his garage building some type of quantum computing adamantium cake based portal gate that will accidentally cause a 3au diameter explosion wiping out our solar system.
*Fixed link.
I'm currently reading Apocalyptic AI: Visions of Heaven in Robotics, Artificial Intelligence, and Virtual Reality by Robert M. Geraci. This book explores how religious ideas have infested our expectations for AI. It's arguments are quite similar to The Secret Life of Puppets by Victoria Nelson which was an even deeper consideration of the metaphysical implications of uncanny representations of human beings whether in the form of dolls, puppets, robots, avatars, or cyborgs. I think it is really important to understand what is driving the push for this technology.
Our Final Invention: Artificial Intelligence and the End of the Human Era by James Barrat is also a good book on the dangers of AI.
You want more book recommendations? Well, one of the creepiest aspects of AI is that Amazon is using it for its recommendation engine. So just go on Amazon and it will be an AI that recommends more books for you to read!
I highly recommend this book
https://www.amazon.com/gp/product/1250058783/ref=pd_sim_14_4?ie=UTF8&psc=1&refRID=MK3J7D3Z2SBNMG6K41WW
I find that more threatening than promising. I recently re-read Blindsight and Echopraxia by Peter Watts. One of his main themes is that transhumans and AIs are making scientific advances that are so far out there that "baseline" humans can't even understand what they're talking about.
The interesting non-fiction book Our Final Invention also touches on this at some length. We might get ever-more amazing discoveries, but the price would be that we really don't know how anything works. We would be as children, taking everything on trust because we're not smart enough to understand the answers or contribute to the conversation. But this presupposes that the AIs or augmented intelligences would be vastly smarter than us, not just tools we ourselves use to ask better questions. Who knows. But an interesting set of questions, in any case.