2011. Scratch the surface of Bostrom, find Yudkowsky. But I would definitely include it on a “Future of AGI reading list” of five to ten books — it presents its perspective very, very well. According to some interpretations of the terms involved, it might be true that every level of intelligence could in principle be paired with almost any goal. Sorry, didn't enjoy the book. SuperIntelligence: The Power of Anticipation!!! Vol. Eliezer Yudkowsky pense que les risques ainsi créés sont plus imprévisibles que toutes les autres sortes de risques[1], et il ajoute que la recherche à ce sujet est biaisée par l’anthropomorphisme : les gens basant leur analyse de l’intelligence artificielle sur leur propre intelligence[21], cela les amène à en sous-estimer les possibilités. The Singularity Is Near: When Humans Transcend Biology, The Inevitable: Understanding the 12 Technological Forces That Will Shape Our Future, The Innovators: How a Group of Hackers, Geniuses, and Geeks Created the Digital Revolution, AI Superpowers: China, Silicon Valley, and the New World Order, Our Final Invention: Artificial Intelligence and the End of the Human Era, The Fourth Age: Smart Robots, Conscious Computers, and the Future of Humanity, How to Create a Mind: The Secret of Human Thought Revealed, Ignition! The AI Lord works in mysterious ways! Dans une interview de mars 2015 avec le PDG de Baidu, Robert Li, M. Gates a affirmé qu'il « recommandait vivement » la lecture du livre de Bostrom[12]. When one hears smart, hard-driving, committed people talk about a certain set of issues in a certain way, it’s easy to get caught up in their way of framing the issues. For instance, from my personal individual perspective, it makes a big difference if a beneficent super-AGI is created in 2030 rather than 2300, because it is fairly likely I’ll still be alive in 2030 to reap the benefits — whereas my persistence by 2300 is much less certain, especially if AGI doesn’t emerge in the interim. Humans already did that much in slave societies. E 3 Tips to Getting The Most Out of Server Virtualization. However, there is also an obvious counterpoint: As humans have not made ants or bacteria obsolete, superhuman AGIs need not make human beings or significantly human-focused global brains obsolete. How are top enterprises effectively applying IoT to their BI strategies? It’s hard to rule out, since we’re talking about radically new technologies and unprecedented situations. The uncertainty about how likely these possibilities are, can certainly feel disturbing — it even does to me, at times, and I’m a tremendous AGI optimist. He discusses the “treacherous turn” problem, i.e., the possibility that a young AGI that seems benevolent might then turn destructive in ways its early human observers did not predict: “The treacherous turn” — While weak, an AI behaves cooperatively (increasingly so, as it gets smarter). Il sépare d’ailleurs les risques en problèmes techniques (des algorithmes imparfaits ou défectueux empêchant l’IA d’atteindre ses objectifs), et en échecs « philosophiques », bien plus pernicieux et difficiles à contrôler, où les objectifs de l’IA sont en fait nuisibles à l’humanité[22] ; de plus, presque par définition, une superintelligence serait si puissante qu'on ne pourrait l'arrêter en cas de comportement imprévu[23]. Dioguardi, N. 1989. Publications. I have to say that if anything, Bostrom's writing reminds me of theology. 2. There's a problem loading this menu right now. The books point is we have to watch out for the time (now?) Comme Marcus Hutter (en) avant lui, Bostrom définit la superintelligence comme une supériorité générale dans les comportements ayant un objectif, laissant ouverte la question de capacités telles que l'intentionnalité[4] ou la perception des qualia[5]. For instance, Yudkowsky’s long-standing preoccupation with “the art of rationality” was originally motivated substantially by a desire to make himself and others rational enough to think effectively about the path to friendly superintelligence. To me this is a very real issue. [1], A number of scientists and forecasters argue for prioritizing early research into the possible benefits and risks of human and machine cognitive enhancement, because of the potential social impact of such technologies. What a huge win for the Yudkowsky/SIAI folks, to have their ideas written up and marketed in a way that managed to appeal to Bill Gates, Elon Musk, Stephen Hawking and so forth! "[8] Moreover, neurons transmit spike signals across axons at no greater than 120 m/s, "whereas existing electronic processing cores can communicate optically at the speed of light". They are going to grow up from a specific starting-point — the AGI systems we create and utilize and teach and interact with — and then they are going to be shaped, as they self-modify, by their interactions with our region of the physical cosmos. Computer Programming: From Machine Language to Artificial Intelligence. Goertzel, B. and L. Muehlhauser, Luke. "Nick Bostrom's excellent book "Superintelligence" is the best thing I've seen on this topic. There have been situations in history where seemingly out-there, abstract mathematics has suddenly turned out to be extremely practically valuable, much to everyone’s surprise. Open ended intelligence: The individuation of intelligent agents. Weaver, the cross-disciplinary thinker whose work on open-ended intelligence I’ve been discussing and improvising on above, is employed in a small but vibrant group called the Global Brain Institute (GBI), housed at the Free University of Brussels (VUB). One core idea here seems to be that a few brilliant, right-thinking mathematicians and philosophers locked in a basement are most probably our best hope to save humanity from the unwitting creation of Unfriendly AI by teams of ambitious but not-quite-smart-enough AI developers. There is no happy end to such stories. 179–183; and p. 47. (The FHI is a multidisciplinary university research center; it is also home to the Center for the Governance of Artificial Intelligence and to teams working on AI safety, biosecurity, macrostrategy, and various other technology or foundational questions.) and Weaver and Veitas’s Open-Ended Intelligence, Superintelligence: fears, promises, and potentials, © 2020 Kurzweil Network | accelerating intelligence —, we co-organized the AGI-Impacts conference at Oxford in 2012. Journal of Consciousness Studies 19(1 –2): 96–111. When this happens, human history will have reached a kind of singularity — a place where extrapolation breaks down and new models must be applied — and the world will pass beyond our understanding.” — Vernor Vinge, True Names and Other Dangers, p. 47. Cosmist goals — for the spread of whatever values we choose around the cosmos … intelligence, life, joy, growth, discovery, etc. This just tells us that there may be some physically-feasible intelligent agents who aren’t that much like humans but still share these general evolution-oriented values. 110 years), and with 90% confidence is 2070 (mean 2168, st. dev. Un système résolvant des problèmes (comme un traducteur automatique ou un assistant à la conception) est parfois aussi décrit comme « superintelligent » s'il dépasse de loin les performances humaines correspondantes, même si cela ne concerne qu'un domaine plus limité. But he argues they will generally focus on the integrity of their goal content and on the acquisition of relevant resources — which in practice will usually amount to the same thing as preserving and propagating themselves and their influence. Due to his background as a child prodigy, and his quick wit and obviously deep mind, he seemed to achieve an almost transhuman status in the minds of many SIAI enthusiasts of that era. He is honest enough to confront the problem head-on, admitting at the start that "many of the points made in this book are probably wrong." And this vibe resonates closely with the explicitly elitist attitude promoted by Peter Thiel, who was a major SIAI donor for a number of years (Reinhart 2011). The problem is that neither Bostrom nor anyone actually knows enough to put a number on this, even a rough one. Final goal: “Maximize the time-discounted integral of your future reward signal”. has to work hard in places to understand all, but an excellent read nonetheless. superintelligence is attained. A paper from a couple decades ago, modeling the liver as a complex 3D self-organizing system that recognizes toxins due to its complex self-organizing activity (, Various perplexing reports of people, after receiving liver transplants, developing tastes similar to those of the liver donor (the liver’s previous “owner”) and different from their own previous tastes (. We just can’t know, any more than ants can predict the odds that a human civilization, when moving onto a new continent, will destroy the ant colonies present there. and B. Herman. The notion of open-ended intelligence ties in with a very different, historically important line of thinking pursued by cross-disciplinary innovator Max More (arguably the founding philosopher of transhumanism). 1. 3. Bostrom does not come right out and say that he thinks the best path forward is for some small vanguard of elite super-programmers and uber-scientists to create Friendly AGI, but he almost does. Please try again. On the other hand, we concurrently confront a minor epidemic of pessimism — at least in the media, and among a handful of high-profile commentators — about the desirability of achieving this goal. In particular, I have argued that AGI has a strong potential to play a temporary role as a “nanny” technology (Goertzel 2012), protecting humanity from its own tendencies toward technological self-destruction, while more and more advanced AGI emerges in a relatively measured way.
Leaf Crossword Clue, My Heart Is Full, Bheemas Restaurant, Zong Film, A Cambridge Companion, I7-9700k Benchmark, How To Gain 20 Kg Weight In 6 Months, Anne Hathaway Vegan Reddit, Kelly Clarkson Engagement Ring Cost,
