Knowledge

Future of Humanity Institute

Source đź“ť

36: 3482: 4658: 3938: 3494: 189:, the institute's stated objective was to focus research where it can make the greatest positive difference for humanity in the long term. It engaged in a mix of academic and outreach activities, seeking to promote informed discussion and public engagement in government, businesses, universities, and other organizations. The centre's largest research funders included 287:, and in particular existential risk. In a 2002 paper, Bostrom defined an "existential risk" as one "where an adverse outcome would either annihilate Earth-originating intelligent life or permanently and drastically curtail its potential". This includes scenarios where humanity is not directly harmed, but it fails to 224:
Nick Bostrom established the institute in November 2005 as part of the Oxford Martin School, then the James Martin 21st Century School. Between 2008 and 2010, FHI hosted the Global Catastrophic Risks conference, wrote 22 academic journal articles, and published 34 chapters in academic volumes. FHI
412:, which claims that humanity is likely to go extinct soon because it is unlikely that one is observing a point in human history that is extremely early. Instead, present-day humans are likely to be near the middle of the distribution of humans that will ever live. Bostrom has also popularized the 427:" preventing space colonization to account for the paradox. That filter may lie in the past, if intelligence is much more rare than current biology would predict; or it may lie in the future, if existential risks are even larger than is currently recognized. 400:
FHI devotes much of its attention to exotic threats that have been little explored by other organizations, and to methodological considerations that inform existential risk reduction and forecasting. The institute has particularly emphasized
466:
FHI's focus has been on methods for assessing and enhancing human intelligence and rationality, as a way of shaping the speed and direction of technological and social progress. FHI's work on human irrationality, as exemplified in
439:. The modifications in question may be biological, digital, or sociological, and an emphasis is placed on the most radical hypothesized changes, rather than on the likeliest short-term innovations. FHI's 361:. In expecting the largest risks to stem from future technologies, and from advanced artificial intelligence in particular, FHI agrees with other existential risk reduction organizations, such as the 3555: 3941: 944: 3548: 856: 3905: 2000: 1464: 497: 382: 4717: 4096: 4299: 3541: 1322: 3622: 3564: 2934: 2273: 2230: 1879: 2199: 813: 291:
and make use of the observable universe's available resources in humanly valuable projects, as discussed in Bostrom's 2003 paper, "Astronomical Waste: The
3693: 2064: 435:
Closely linked to FHI's work on risk assessment, astronomical waste, and the dangers of future technologies is its work on the promise and risks of
4697: 4682: 4270: 3733: 3327: 1049: 613: 1075: 731: 4490: 4380: 3728: 3225: 4089: 3912: 3892: 2144: 2007: 1718: 1471: 516: 258: 1583: 1505: 1236: 212:
The University of Oxford closed the Institute on 16 April 2024, which claimed it had "faced increasing administrative headwinds within the
1101: 4055: 2278: 642: 269:
recommended a grant of up to approximately ÂŁ13.4 million to FHI over three years, with a large portion conditional on successful hiring.
213: 159: 118: 1262: 2381: 1553: 1315: 468: 4082: 3698: 3384: 3322: 1728: 362: 4712: 4702: 4277: 4033: 3738: 2057: 1808: 366: 4692: 4687: 1386: 863: 2463: 1308: 545: 828: 306:
collects essays on a variety of such risks, both natural and anthropogenic. Possible catastrophic risks from nature include
4707: 2401: 3972: 2956: 2396: 2295: 1723: 791: 570: 4373: 3880: 3356: 2050: 889: 4345: 3617: 2376: 581: 565: 525: 697: 369:. FHI researchers have also studied the impact of technological progress on social and institutional risks, such as 3627: 2941: 2637: 1823: 1563: 1498: 1450: 536: 266: 4294: 4062: 3582: 2988: 2485: 2458: 2089: 1965: 1733: 1182: 358: 237:), as well as to governmental bodies in Sweden, Singapore, Belgium, the United Kingdom, and the United States. 4023: 3688: 2346: 1929: 506: 386:, in which he argues that safeguarding humanity's future is among the most important moral issues of our time. 4366: 2736: 2642: 2094: 1713: 1543: 1426: 769: 186: 341:
are given more attention by FHI. Technological outcomes the institute is particularly interested in include
158:
investigating big-picture questions about humanity and its prospects. It was founded in 2005 as part of the
4608: 4563: 3919: 3779: 2786: 2686: 1828: 1708: 456: 423:, the surprising absence of observable alien civilizations. Robin Hanson has argued that there must be a " 3925: 3520: 3269: 2468: 2418: 1979: 1924: 1491: 4573: 2929: 2781: 2756: 2166: 1695: 1588: 1411: 374: 739: 4424: 4335: 4164: 3678: 3662: 3612: 3399: 3332: 3175: 2907: 2902: 2776: 2606: 2448: 2235: 2031: 1958: 1818: 1703: 940: 234: 198: 1007: 4429: 4408: 4340: 4144: 4105: 3713: 3632: 3505: 3394: 3289: 3215: 3042: 2671: 2371: 2073: 1986: 1899: 1884: 1758: 1457: 1416: 1391: 603: 354: 284: 202: 20: 334:
may be exceptions as a result of being more common, and of dovetailing with technological trends.
4159: 3965: 3568: 3500: 3069: 2924: 2220: 1788: 1538: 249: 3533: 1240: 252:(AI). In 2014, its researchers published several books on AI risk, including Stuart Armstrong's 4661: 4149: 3637: 3515: 3349: 3296: 3190: 3013: 2858: 2216: 2014: 1843: 1578: 1237:"Amlin and Oxford University launch major research project into the Systemic Risk of Modelling" 1002: 531: 299: 650: 586: 3592: 2919: 2731: 2193: 2154: 1972: 1934: 1443: 1421: 1208: 330:. These dangers are characterized as relatively small and relatively well understood, though 4528: 4623: 4464: 3683: 3284: 3081: 2983: 2848: 2810: 2560: 2364: 2258: 1598: 230: 226: 163: 155: 122: 8: 4507: 4480: 4263: 4195: 4119: 3898: 3425: 3205: 3076: 2998: 2596: 2542: 2490: 2453: 2443: 2149: 1833: 1401: 413: 402: 395: 4454: 4221: 3958: 3128: 3123: 3101: 3086: 2978: 2766: 2746: 2696: 2659: 2649: 2500: 2337: 1914: 1874: 1859: 1813: 1778: 1748: 1533: 1514: 1020: 618: 288: 175: 405:
in its research, as an under-explored area with general epistemological implications.
4643: 4633: 4613: 4179: 4124: 4007: 3864: 3839: 3657: 3361: 3262: 3057: 2865: 2830: 2791: 2741: 2632: 2616: 2359: 2322: 2300: 2285: 2268: 2186: 1951: 1803: 1798: 1674: 1639: 1614: 1528: 1127: 990: 807: 577: 561: 556: 541: 521: 502: 436: 409: 350: 151: 1024: 35: 4638: 4246: 4231: 4134: 4129: 3997: 3886: 3859: 3759: 3607: 3510: 3445: 3274: 3252: 3096: 3064: 3052: 3028: 2654: 2601: 2591: 2550: 2480: 2475: 2204: 2112: 1993: 1644: 1634: 1573: 1012: 551: 338: 292: 278: 241: 206: 1076:"Cambridge University study centre focuses on risks that could annihilate mankind" 4618: 4588: 4533: 4216: 3824: 3804: 3794: 3784: 3718: 3652: 3339: 3180: 2751: 2611: 2527: 2515: 2495: 2391: 2181: 2161: 2084: 1763: 1738: 1558: 1365: 1350: 608: 370: 346: 315: 171: 3481: 4548: 4459: 4449: 4315: 4241: 4226: 3647: 3317: 3257: 3242: 3195: 3091: 3037: 2897: 2555: 2532: 2505: 2423: 2413: 2315: 2310: 2176: 2127: 1919: 1909: 1894: 1864: 1838: 1783: 1629: 1593: 1548: 1370: 1300: 991:"Astronomical Waste: The Opportunity Cost of Delayed Technological Development" 472: 460: 448: 342: 1016: 4676: 4578: 4553: 4444: 4389: 4325: 3854: 3799: 3769: 3460: 3344: 3301: 3247: 3235: 3220: 3210: 3133: 3047: 3023: 3018: 2892: 2887: 2882: 2798: 2386: 2327: 2290: 2242: 1889: 1869: 1793: 1406: 960:"Existential Risks: Analyzing Human Extinction Scenarios and Related Hazards" 959: 915: 480: 452: 420: 2042: 4628: 4593: 4583: 4568: 4543: 4523: 4434: 4320: 4236: 4139: 4074: 4002: 3844: 3774: 3587: 3486: 3420: 3152: 3138: 2993: 2803: 2771: 2761: 2664: 2510: 2408: 2354: 2263: 2122: 1768: 1690: 1664: 1659: 1649: 1624: 1396: 1355: 1345: 511: 444: 424: 311: 307: 167: 133: 106: 248:
in March 2009. Most recently, FHI has focused on the dangers of advanced
4538: 4439: 4169: 3849: 3834: 3642: 3602: 3465: 3008: 3003: 2840: 2825: 2701: 2676: 2305: 2225: 2132: 2117: 1743: 1568: 705: 323: 3147: 761: 4485: 4403: 3814: 3789: 3764: 3723: 3703: 3415: 3230: 3200: 3185: 2973: 2961: 2721: 2583: 2209: 1619: 672: 573:
Anthropic Bias: Observation Selection Effects in Science and Philosophy
319: 4603: 4501: 3982: 3829: 3819: 3597: 3157: 2946: 2875: 2820: 2815: 2681: 2522: 2428: 2171: 1669: 1483: 1102:"Oxford Future of Humanity Institute knows what will make us extinct" 833: 440: 327: 194: 1263:"Amlin and Oxford University to collaborate on modelling risk study" 829:"Institute That Pioneered AI 'Existential Risk' Research Shuts Down" 4598: 4330: 4174: 4154: 3809: 3450: 3435: 2966: 2951: 2853: 2691: 2139: 1904: 1773: 1654: 1360: 1128:"Information Hazards: A Typology of Potential Harms from Knowledge" 492: 331: 179: 945:"Future of Humanity Institute — Work on Global Catastrophic Risks" 4558: 4038: 3563: 3430: 3279: 3116: 3106: 2914: 2726: 2438: 2433: 94: 4358: 380:
In 2020, FHI Senior Research Fellow Toby Ord published his book
3743: 3440: 3366: 90: 82:
Research big-picture questions about humanity and its prospects
3111: 2870: 476: 190: 3950: 1206: 1157:"The Precipice: Existential Risk and the Future of Humanity" 1156: 794:. 17 April 2024. Archived from the original on 17 April 2024 3455: 1293: 498:
The Precipice: Existential Risk and the Future of Humanity
383:
The Precipice: Existential Risk and the Future of Humanity
939: 890:"AI uprising: humans will be outsourced, not obliterated" 1239:(Press release). Amlin. 11 February 2014. Archived from 862:(Report). Future of Humanity Institute. Archived from 3623:
Existential risk from artificial general intelligence
2274:
Self-indication assumption doomsday argument rebuttal
1880:
Existential risk from artificial general intelligence
2200:
Safety of high-energy particle collision experiments
1700:
All-Party Parliamentary Group for Future Generations
1050:"We're Underestimating the Risk of Human Extinction" 430: 229:, to the private and non-profit sector (such as the 3694:
Center for Human-Compatible Artificial Intelligence
4300:Drexler–Smalley debate on molecular nanotechnology 443:research focuses on the potential consequences of 283:The largest topic FHI has spent time exploring is 643:"Humanity's Future: Future of Humanity Institute" 4718:Organizations associated with effective altruism 4674: 4271:Great Mambo Chicken and the Transhuman Condition 3734:Leverhulme Centre for the Future of Intelligence 3328:List of apocalyptic and post-apocalyptic fiction 1330: 812:: CS1 maint: bot: original URL status unknown ( 614:Leverhulme Centre for the Future of Intelligence 408:Anthropic arguments FHI has studied include the 16:Defunct Oxford interdisciplinary research centre 1099: 185:Sharing an office and working closely with the 4491:Institute for Ethics and Emerging Technologies 3729:Institute for Ethics and Emerging Technologies 3226:List of dates predicted for apocalyptic events 1719:Centre for Enabling EA Learning & Research 1073: 4374: 4090: 3966: 3913:Superintelligence: Paths, Dangers, Strategies 3893:Open letter on artificial intelligence (2015) 3549: 2231:Existential risk from artificial intelligence 2072: 2058: 2008:Superintelligence: Paths, Dangers, Strategies 1499: 1472:Superintelligence: Paths, Dangers, Strategies 1316: 1183:"How close is humanity to destroying itself?" 1047: 729: 517:Superintelligence: Paths, Dangers, Strategies 259:Superintelligence: Paths, Dangers, Strategies 4104: 1584:Psychological barriers to effective altruism 988: 957: 887: 854: 314:, and energetic astronomical events such as 225:researchers have given policy advice at the 4056:Harry Potter and the Methods of Rationality 2279:Self-referencing doomsday argument rebuttal 1043: 1041: 419:A recurring theme in FHI's research is the 170:, and its research staff included futurist 4381: 4367: 4097: 4083: 3973: 3959: 3556: 3542: 2382:Climate change and civilizational collapse 2065: 2051: 1554:Distributional cost-effectiveness analysis 1506: 1492: 1323: 1309: 34: 1267:Continuity, Insurance & Risk Magazine 1006: 916:"How are humans going to become extinct?" 475:, includes an ongoing collaboration with 3699:Centre for the Study of Existential Risk 3385:Centre for the Study of Existential Risk 3323:Apocalyptic and post-apocalyptic fiction 1729:Centre for the Study of Existential Risk 1125: 1038: 913: 637: 635: 486: 363:Centre for the Study of Existential Risk 4698:Research institutes established in 2005 4683:Departments of the University of Oxford 4034:Machine Intelligence Research Institute 3739:Machine Intelligence Research Institute 1809:Machine Intelligence Research Institute 1180: 826: 367:Machine Intelligence Research Institute 295:of Delayed Technological Development". 4675: 1513: 1387:Differential technological development 725: 723: 389: 4362: 4078: 3954: 3537: 2046: 1487: 1304: 632: 4278:There's Plenty of Room at the Bottom 2402:Tipping points in the climate system 772:from the original on 20 October 2021 2397:Extinction risk from climate change 2296:New World Order (conspiracy theory) 1724:Center for High Impact Philanthropy 964:Journal of Evolution and Technology 720: 337:Synthetic pandemics via weaponized 272: 13: 3881:Statement on AI risk of extinction 3357:List of fictional doomsday devices 1209:"Whole Brain Emulation: A Roadmap" 1207:Anders Sandberg and Nick Bostrom. 1100:Jenny Hollander (September 2012). 827:Maiberg, Emanuel (17 April 2024). 730:Ross Andersen (25 February 2013). 587:Nick Bostrom and Anders Sandberg: 14: 4729: 4388: 3618:Ethics of artificial intelligence 2377:Cataclysmic pole shift hypothesis 1285: 483:arising from biases in modeling. 431:Human enhancement and rationality 4657: 4656: 3937: 3936: 3628:Friendly artificial intelligence 3493: 3492: 3480: 2638:Decline in amphibian populations 1564:Equal consideration of interests 1074:Kate Whitehead (16 March 2014). 914:Coughlan, Sean (24 April 2013). 4295:Feynman Prize in Nanotechnology 4063:Rationality: From AI to Zombies 2989:Four Horsemen of the Apocalypse 2486:Land surface effects on climate 2459:Human impact on the environment 2090:Future of an expanding universe 1966:Famine, Affluence, and Morality 1734:Development Media International 1255: 1229: 1200: 1174: 1154: 1148: 1119: 1093: 1067: 982: 951: 933: 907: 359:artificial general intelligence 166:. Its director was philosopher 4713:Existential risk organizations 4703:2005 establishments in England 4024:Center for Applied Rationality 3689:Center for Applied Rationality 1930:Risk of astronomical suffering 1048:Ross Andersen (6 March 2012). 989:Nick Bostrom (November 2003). 881: 857:Achievements Report: 2008-2010 848: 820: 792:"Future of Humanity Institute" 784: 754: 690: 665: 375:automation-driven unemployment 1: 4693:Research institutes in Oxford 4688:Futures studies organizations 3980: 2935:Interpretations of Revelation 2737:Cosmological phase transition 2643:Decline in insect populations 2095:Ultimate fate of the universe 1714:Centre for Effective Altruism 1544:Disability-adjusted life year 1181:Chivers, Tom (7 March 2020). 855:Nick Bostrom (18 July 2007). 625: 187:Centre for Effective Altruism 134:futureofhumanityinstitute.org 4564:Nikolai Fyodorovich Fyodorov 4496:Future of Humanity Institute 4201:Future of Humanity Institute 4029:Future of Humanity Institute 3709:Future of Humanity Institute 3390:Future of Humanity Institute 2787:Potentially hazardous object 2687:Interplanetary contamination 1829:Raising for Effective Giving 1754:Future of Humanity Institute 1332:Future of Humanity Institute 1216:Future of Humanity Institute 1135:Future of Humanity Institute 888:Mark Piesing (17 May 2012). 766:Future of Humanity Institute 702:Future of Humanity Institute 677:Future of Humanity Institute 343:anthropogenic climate change 144:Future of Humanity Institute 29:Future of Humanity Institute 7: 4708:Transhumanist organizations 3926:Artificial Intelligence Act 3920:Do You Trust This Computer? 3270:Nemesis (hypothetical star) 2419:Global terrestrial stilling 1980:Living High and Letting Die 1925:Neglected tropical diseases 958:Nick Bostrom (March 2002). 596: 377:, and information hazards. 48:; 19 years ago 10: 4734: 2782:Asteroid impact prediction 2757:Heat death of the universe 2167:Mutual assured destruction 1696:Against Malaria Foundation 1589:Quality-adjusted life year 1412:Self-indication assumption 393: 276: 219: 18: 4652: 4516: 4473: 4417: 4396: 4336:Technological singularity 4308: 4287: 4255: 4209: 4188: 4165:Carbon nanotube nanomotor 4112: 4047: 4016: 3990: 3934: 3873: 3752: 3679:Alignment Research Center 3671: 3663:Technological singularity 3613:Effective accelerationism 3575: 3474: 3408: 3400:Nuclear Threat Initiative 3377: 3333:List of apocalyptic films 3310: 3176:2011 end times prediction 3168: 2908:Prophecy of Seventy Weeks 2903:Abomination of desolation 2839: 2777:Asteroid impact avoidance 2714: 2625: 2607:List of extinction events 2582: 2575: 2541: 2449:Environmental degradation 2345: 2336: 2251: 2236:Technological singularity 2105: 2080: 2074:Global catastrophic risks 2032:Effective Altruism Global 2024: 1959:The End of Animal Farming 1943: 1852: 1819:Nuclear Threat Initiative 1704:Animal Charity Evaluators 1683: 1607: 1521: 1451:Global Catastrophic Risks 1435: 1379: 1338: 1017:10.1017/s0953820800004076 941:Open Philanthropy Project 537:Global Catastrophic Risks 457:brain–computer interfaces 304:Global Catastrophic Risks 235:World Health Organization 199:European Research Council 128: 112: 100: 86: 78: 60: 42: 33: 4430:Eradication of suffering 4409:Transhumanism in fiction 4341:Impact of nanotechnology 4145:Self-replicating machine 4106:Molecular nanotechnology 3714:Future of Life Institute 3633:Instrumental convergence 3395:Future of Life Institute 3297:Resurrection of the dead 3290:Post-tribulation rapture 2672:Colony collapse disorder 1987:The Most Good You Can Do 1900:Intensive animal farming 1885:Global catastrophic risk 1759:Future of Life Institute 1417:Self-sampling assumption 1392:Global catastrophic risk 1080:South China Morning Post 604:Future of Life Institute 355:molecular nanotechnology 285:global catastrophic risk 244:also published the book 240:Bostrom and bioethicist 203:Future of Life Institute 21:Future of Life Institute 19:Not to be confused with 4160:Exploratory engineering 3569:artificial intelligence 2221:Artificial intelligence 1789:The Good Food Institute 1539:Demandingness objection 589:Brain Emulation Roadmap 250:artificial intelligence 154:research centre at the 4508:US Transhumanist Party 4150:Productive nanosystems 3638:Intelligence explosion 3350:List of disaster films 3191:Apocalyptic literature 2291:Malthusian catastrophe 2217:Synthetic intelligence 2015:What We Owe the Future 1844:Wild Animal Initiative 1579:Moral circle expansion 66:; 5 months ago 3593:AI capability control 2732:Coronal mass ejection 2194:Electromagnetic pulse 2155:Kinetic energy weapon 1973:The Life You Can Save 1935:Wild animal suffering 1422:Simulation hypothesis 1161:The Precipice Website 487:Selected publications 214:Faculty of Philosophy 160:Faculty of Philosophy 119:Faculty of Philosophy 4624:Gennady Stolyarov II 4465:Techno-progressivism 3684:Center for AI Safety 3134:War of Gog and Magog 2811:Near-Earth supernova 2561:Human overpopulation 2365:Mass mortality event 2259:Anthropogenic hazard 1599:Venture philanthropy 1294:FHI official website 647:Oxford Martin School 469:cognitive heuristics 231:Macarthur Foundation 227:World Economic Forum 164:Oxford Martin School 156:University of Oxford 123:University of Oxford 4481:Foresight Institute 4264:Engines of Creation 4196:Foresight Institute 4120:Molecular assembler 3899:Our Final Invention 3206:Blood moon prophecy 2999:Number of the Beast 2597:Holocene extinction 2543:Earth Overshoot Day 2491:Ocean acidification 2454:Habitat destruction 2444:Ecological collapse 2150:Kinetic bombardment 2085:Future of the Earth 1834:Sentience Institute 869:on 21 December 2012 414:simulation argument 403:anthropic reasoning 396:Anthropic principle 390:Anthropic reasoning 114:Parent organization 64:April 16, 2024 30: 4529:JosĂ© Luis Cordeiro 4455:Singularitarianism 4222:Christine Peterson 3521:Doomsday scenarios 3087:Beast of the Earth 2979:Book of Revelation 2767:Virtual black hole 2747:False vacuum decay 2697:Pollinator decline 2660:Biological warfare 2650:Biotechnology risk 2501:Resource depletion 1915:Malaria prevention 1875:Economic stability 1860:Biotechnology risk 1814:Malaria Consortium 1779:Giving What We Can 1749:Fistula Foundation 1534:Charity assessment 1515:Effective altruism 1269:. 11 February 2014 742:on 9 February 2014 708:on 1 December 2015 619:Effective altruism 176:Giving What We Can 28: 4670: 4669: 4644:Eliezer Yudkowsky 4634:Natasha Vita-More 4614:Martine Rothblatt 4356: 4355: 4180:Starseed launcher 4125:Molecular machine 4072: 4071: 4008:Eliezer Yudkowsky 3948: 3947: 3865:Eliezer Yudkowsky 3840:Stuart J. Russell 3658:Superintelligence 3531: 3530: 3362:Zombie apocalypse 3263:Postmillennialism 3058:Great Tribulation 2831:Stellar collision 2792:Near-Earth object 2742:Geomagnetic storm 2710: 2709: 2633:Biodiversity loss 2617:Genetic pollution 2571: 2570: 2360:Biodiversity loss 2323:Societal collapse 2301:Nuclear holocaust 2286:Economic collapse 2269:Doomsday argument 2187:Antimatter weapon 2040: 2039: 1952:Doing Good Better 1824:Open Philanthropy 1804:Mercy for Animals 1799:The Humane League 1675:Eliezer Yudkowsky 1640:William MacAskill 1615:Sam Bankman-Fried 1529:Aid effectiveness 1481: 1480: 1458:Human Enhancement 557:Human Enhancement 550:Nick Bostrom and 546:978-0-19-857050-9 530:Nick Bostrom and 437:human enhancement 410:doomsday argument 351:nuclear terrorism 339:biological agents 267:Open Philanthropy 246:Human Enhancement 152:interdisciplinary 140: 139: 4725: 4660: 4659: 4639:Mark Alan Walker 4383: 4376: 4369: 4360: 4359: 4247:James C. Bennett 4232:Carlo Montemagno 4135:Mechanochemistry 4130:Mechanosynthesis 4099: 4092: 4085: 4076: 4075: 3975: 3968: 3961: 3952: 3951: 3940: 3939: 3887:Human Compatible 3860:Roman Yampolskiy 3608:Consequentialism 3565:Existential risk 3558: 3551: 3544: 3535: 3534: 3496: 3495: 3487:World portal 3485: 3484: 3446:Financial crisis 3275:Nibiru cataclysm 3253:Premillennialism 3097:Dhul-Suwayqatayn 3065:Son of perdition 3053:Olivet Discourse 3029:Whore of Babylon 2655:Biological agent 2602:Human extinction 2592:Extinction event 2580: 2579: 2551:Overexploitation 2481:Land consumption 2476:Land degradation 2343: 2342: 2205:Micro black hole 2113:Chemical warfare 2067: 2060: 2053: 2044: 2043: 1994:Practical Ethics 1645:Dustin Moskovitz 1635:Holden Karnofsky 1574:Marginal utility 1508: 1501: 1494: 1485: 1484: 1402:Pascal's mugging 1325: 1318: 1311: 1302: 1301: 1297: 1296: 1279: 1278: 1276: 1274: 1259: 1253: 1252: 1250: 1248: 1243:on 13 April 2014 1233: 1227: 1226: 1224: 1222: 1213: 1204: 1198: 1197: 1195: 1193: 1178: 1172: 1171: 1169: 1167: 1152: 1146: 1145: 1143: 1141: 1132: 1123: 1117: 1116: 1114: 1112: 1097: 1091: 1090: 1088: 1086: 1071: 1065: 1064: 1062: 1060: 1045: 1036: 1035: 1033: 1031: 1010: 986: 980: 979: 977: 975: 955: 949: 948: 937: 931: 930: 928: 926: 911: 905: 904: 902: 900: 885: 879: 878: 876: 874: 868: 861: 852: 846: 845: 843: 841: 824: 818: 817: 811: 803: 801: 799: 788: 782: 781: 779: 777: 758: 752: 751: 749: 747: 738:. Archived from 727: 718: 717: 715: 713: 704:. Archived from 694: 688: 687: 685: 683: 669: 663: 662: 660: 658: 653:on 17 March 2014 649:. Archived from 639: 552:Julian Savulescu 316:gamma-ray bursts 293:Opportunity Cost 279:Existential risk 273:Existential risk 242:Julian Savulescu 207:Leverhulme Trust 136: 74: 72: 67: 56: 54: 49: 38: 31: 27: 4733: 4732: 4728: 4727: 4726: 4724: 4723: 4722: 4673: 4672: 4671: 4666: 4648: 4619:Anders Sandberg 4589:Ole Martin Moen 4534:K. Eric Drexler 4512: 4469: 4413: 4392: 4387: 4357: 4352: 4304: 4283: 4251: 4217:K. Eric Drexler 4205: 4184: 4108: 4103: 4073: 4068: 4043: 4012: 3998:Scott Alexander 3986: 3979: 3949: 3944: 3930: 3869: 3825:Steve Omohundro 3805:Geoffrey Hinton 3795:Stephen Hawking 3780:Paul Christiano 3760:Scott Alexander 3748: 3719:Google DeepMind 3667: 3653:Suffering risks 3571: 3562: 3532: 3527: 3506:Future problems 3479: 3470: 3404: 3373: 3340:Climate fiction 3306: 3181:2012 phenomenon 3164: 3070:Sheep and Goats 2957:2 Thessalonians 2835: 2752:Gamma-ray burst 2706: 2621: 2612:Genetic erosion 2567: 2537: 2528:Water pollution 2496:Ozone depletion 2392:Desertification 2332: 2247: 2182:Doomsday device 2162:Nuclear warfare 2101: 2076: 2071: 2041: 2036: 2020: 1939: 1905:Land use reform 1848: 1764:Founders Pledge 1739:Evidence Action 1679: 1603: 1559:Earning to give 1517: 1512: 1482: 1477: 1431: 1375: 1366:Anders Sandberg 1351:K. Eric Drexler 1334: 1329: 1292: 1291: 1288: 1283: 1282: 1272: 1270: 1261: 1260: 1256: 1246: 1244: 1235: 1234: 1230: 1220: 1218: 1211: 1205: 1201: 1191: 1189: 1179: 1175: 1165: 1163: 1153: 1149: 1139: 1137: 1130: 1124: 1120: 1110: 1108: 1098: 1094: 1084: 1082: 1072: 1068: 1058: 1056: 1046: 1039: 1029: 1027: 1008:10.1.1.429.2849 987: 983: 973: 971: 956: 952: 938: 934: 924: 922: 912: 908: 898: 896: 886: 882: 872: 870: 866: 859: 853: 849: 839: 837: 825: 821: 805: 804: 797: 795: 790: 789: 785: 775: 773: 760: 759: 755: 745: 743: 728: 721: 711: 709: 696: 695: 691: 681: 679: 671: 670: 666: 656: 654: 641: 640: 633: 628: 623: 609:Futures studies 599: 489: 433: 398: 392: 371:totalitarianism 347:nuclear warfare 308:super-volcanism 281: 275: 254:Smarter Than Us 222: 172:Anders Sandberg 132: 115: 103: 70: 68: 65: 52: 50: 47: 24: 17: 12: 11: 5: 4731: 4721: 4720: 4715: 4710: 4705: 4700: 4695: 4690: 4685: 4668: 4667: 4665: 4664: 4653: 4650: 4649: 4647: 4646: 4641: 4636: 4631: 4626: 4621: 4616: 4611: 4606: 4601: 4596: 4591: 4586: 4581: 4576: 4571: 4566: 4561: 4556: 4551: 4549:Aubrey de Grey 4546: 4541: 4536: 4531: 4526: 4520: 4518: 4514: 4513: 4511: 4510: 4505: 4498: 4493: 4488: 4483: 4477: 4475: 4471: 4470: 4468: 4467: 4462: 4460:Technogaianism 4457: 4452: 4450:Postpoliticism 4447: 4442: 4437: 4432: 4427: 4425:Antinaturalism 4421: 4419: 4415: 4414: 4412: 4411: 4406: 4400: 4398: 4394: 4393: 4386: 4385: 4378: 4371: 4363: 4354: 4353: 4351: 4350: 4349: 4348: 4338: 4333: 4328: 4323: 4318: 4316:Nanotechnology 4312: 4310: 4309:Related topics 4306: 4305: 4303: 4302: 4297: 4291: 4289: 4285: 4284: 4282: 4281: 4274: 4267: 4259: 4257: 4253: 4252: 4250: 4249: 4244: 4242:Robert Freitas 4239: 4234: 4229: 4227:J. Storrs Hall 4224: 4219: 4213: 4211: 4207: 4206: 4204: 4203: 4198: 4192: 4190: 4186: 4185: 4183: 4182: 4177: 4172: 4167: 4162: 4157: 4152: 4147: 4142: 4137: 4132: 4127: 4122: 4116: 4114: 4110: 4109: 4102: 4101: 4094: 4087: 4079: 4070: 4069: 4067: 4066: 4059: 4051: 4049: 4045: 4044: 4042: 4041: 4036: 4031: 4026: 4020: 4018: 4014: 4013: 4011: 4010: 4005: 4000: 3994: 3992: 3988: 3987: 3978: 3977: 3970: 3963: 3955: 3946: 3945: 3935: 3932: 3931: 3929: 3928: 3923: 3916: 3909: 3902: 3895: 3890: 3883: 3877: 3875: 3871: 3870: 3868: 3867: 3862: 3857: 3852: 3847: 3842: 3837: 3832: 3827: 3822: 3817: 3812: 3807: 3802: 3797: 3792: 3787: 3782: 3777: 3772: 3767: 3762: 3756: 3754: 3750: 3749: 3747: 3746: 3741: 3736: 3731: 3726: 3721: 3716: 3711: 3706: 3701: 3696: 3691: 3686: 3681: 3675: 3673: 3669: 3668: 3666: 3665: 3660: 3655: 3650: 3648:Machine ethics 3645: 3640: 3635: 3630: 3625: 3620: 3615: 3610: 3605: 3600: 3595: 3590: 3585: 3579: 3577: 3573: 3572: 3561: 3560: 3553: 3546: 3538: 3529: 3528: 3526: 3525: 3524: 3523: 3518: 3513: 3508: 3503: 3501:Apocalypticism 3490: 3475: 3472: 3471: 3469: 3468: 3463: 3458: 3453: 3448: 3443: 3438: 3433: 3428: 3423: 3418: 3412: 3410: 3406: 3405: 3403: 3402: 3397: 3392: 3387: 3381: 3379: 3375: 3374: 3372: 3371: 3370: 3369: 3359: 3354: 3353: 3352: 3345:Disaster films 3342: 3337: 3336: 3335: 3330: 3320: 3318:Alien invasion 3314: 3312: 3308: 3307: 3305: 3304: 3299: 3294: 3293: 3292: 3287: 3277: 3272: 3267: 3266: 3265: 3260: 3258:Amillennialism 3255: 3245: 3243:Millenarianism 3240: 3239: 3238: 3228: 3223: 3218: 3213: 3208: 3203: 3198: 3196:Apocalypticism 3193: 3188: 3183: 3178: 3172: 3170: 3166: 3165: 3163: 3162: 3161: 3160: 3150: 3145: 3144: 3143: 3142: 3141: 3136: 3131: 3121: 3120: 3119: 3114: 3109: 3104: 3099: 3094: 3092:Dhu al-Qarnayn 3089: 3084: 3074: 3073: 3072: 3067: 3062: 3061: 3060: 3050: 3045: 3040: 3038:Great Apostasy 3035: 3034: 3033: 3032: 3031: 3026: 3021: 3016: 3011: 3006: 3001: 2996: 2991: 2976: 2971: 2970: 2969: 2964: 2954: 2949: 2944: 2939: 2938: 2937: 2927: 2917: 2912: 2911: 2910: 2905: 2895: 2885: 2883:Last Judgement 2880: 2879: 2878: 2873: 2863: 2862: 2861: 2856: 2845: 2843: 2841:Eschatological 2837: 2836: 2834: 2833: 2828: 2823: 2818: 2813: 2808: 2807: 2806: 2801: 2796: 2795: 2794: 2784: 2779: 2769: 2764: 2759: 2754: 2749: 2744: 2739: 2734: 2729: 2724: 2718: 2716: 2712: 2711: 2708: 2707: 2705: 2704: 2699: 2694: 2689: 2684: 2679: 2674: 2669: 2668: 2667: 2662: 2657: 2647: 2646: 2645: 2640: 2629: 2627: 2623: 2622: 2620: 2619: 2614: 2609: 2604: 2599: 2594: 2588: 2586: 2577: 2573: 2572: 2569: 2568: 2566: 2565: 2564: 2563: 2556:Overpopulation 2553: 2547: 2545: 2539: 2538: 2536: 2535: 2533:Water scarcity 2530: 2525: 2520: 2519: 2518: 2508: 2506:Sea level rise 2503: 2498: 2493: 2488: 2483: 2478: 2473: 2472: 2471: 2469:on marine life 2466: 2456: 2451: 2446: 2441: 2436: 2431: 2426: 2424:Global warming 2421: 2416: 2414:Global dimming 2411: 2406: 2405: 2404: 2394: 2389: 2384: 2379: 2374: 2372:Cascade effect 2369: 2368: 2367: 2357: 2351: 2349: 2347:Climate change 2340: 2334: 2333: 2331: 2330: 2325: 2320: 2319: 2318: 2313: 2308: 2298: 2293: 2288: 2283: 2282: 2281: 2276: 2266: 2261: 2255: 2253: 2249: 2248: 2246: 2245: 2240: 2239: 2238: 2233: 2228: 2214: 2213: 2212: 2207: 2197: 2191: 2190: 2189: 2184: 2179: 2177:Doomsday Clock 2174: 2169: 2159: 2158: 2157: 2147: 2142: 2137: 2136: 2135: 2130: 2128:Cyberterrorism 2125: 2115: 2109: 2107: 2103: 2102: 2100: 2099: 2098: 2097: 2087: 2081: 2078: 2077: 2070: 2069: 2062: 2055: 2047: 2038: 2037: 2035: 2034: 2028: 2026: 2022: 2021: 2019: 2018: 2011: 2004: 1997: 1990: 1983: 1976: 1969: 1962: 1955: 1947: 1945: 1941: 1940: 1938: 1937: 1932: 1927: 1922: 1920:Mass deworming 1917: 1912: 1910:Life extension 1907: 1902: 1897: 1895:Global poverty 1892: 1887: 1882: 1877: 1872: 1867: 1865:Climate change 1862: 1856: 1854: 1850: 1849: 1847: 1846: 1841: 1839:Unlimit Health 1836: 1831: 1826: 1821: 1816: 1811: 1806: 1801: 1796: 1791: 1786: 1784:Good Food Fund 1781: 1776: 1771: 1766: 1761: 1756: 1751: 1746: 1741: 1736: 1731: 1726: 1721: 1716: 1711: 1706: 1701: 1698: 1693: 1687: 1685: 1681: 1680: 1678: 1677: 1672: 1667: 1662: 1657: 1652: 1647: 1642: 1637: 1632: 1630:Hilary Greaves 1627: 1622: 1617: 1611: 1609: 1605: 1604: 1602: 1601: 1596: 1594:Utilitarianism 1591: 1586: 1581: 1576: 1571: 1566: 1561: 1556: 1551: 1549:Disease burden 1546: 1541: 1536: 1531: 1525: 1523: 1519: 1518: 1511: 1510: 1503: 1496: 1488: 1479: 1478: 1476: 1475: 1468: 1461: 1454: 1447: 1444:Anthropic Bias 1439: 1437: 1433: 1432: 1430: 1429: 1424: 1419: 1414: 1409: 1404: 1399: 1394: 1389: 1383: 1381: 1377: 1376: 1374: 1373: 1371:Rebecca Roache 1368: 1363: 1358: 1353: 1348: 1342: 1340: 1336: 1335: 1328: 1327: 1320: 1313: 1305: 1299: 1298: 1287: 1286:External links 1284: 1281: 1280: 1254: 1228: 1199: 1173: 1147: 1126:Nick Bostrom. 1118: 1092: 1066: 1037: 1001:(3): 308–314. 981: 950: 932: 906: 880: 847: 819: 783: 753: 719: 689: 664: 630: 629: 627: 624: 622: 621: 616: 611: 606: 600: 598: 595: 594: 593: 584: 571:Nick Bostrom: 568: 548: 532:Milan Ćirković 528: 509: 488: 485: 461:mind uploading 453:brain implants 449:life extension 432: 429: 394:Main article: 391: 388: 300:Milan Ćirković 289:colonize space 277:Main article: 274: 271: 256:and Bostrom's 221: 218: 138: 137: 130: 126: 125: 116: 113: 110: 109: 104: 101: 98: 97: 88: 84: 83: 80: 76: 75: 62: 58: 57: 44: 40: 39: 15: 9: 6: 4: 3: 2: 4730: 4719: 4716: 4714: 4711: 4709: 4706: 4704: 4701: 4699: 4696: 4694: 4691: 4689: 4686: 4684: 4681: 4680: 4678: 4663: 4655: 4654: 4651: 4645: 4642: 4640: 4637: 4635: 4632: 4630: 4627: 4625: 4622: 4620: 4617: 4615: 4612: 4610: 4607: 4605: 4602: 4600: 4597: 4595: 4592: 4590: 4587: 4585: 4582: 4580: 4579:Julian Huxley 4577: 4575: 4572: 4570: 4567: 4565: 4562: 4560: 4557: 4555: 4554:Zoltan Istvan 4552: 4550: 4547: 4545: 4542: 4540: 4537: 4535: 4532: 4530: 4527: 4525: 4522: 4521: 4519: 4515: 4509: 4506: 4504: 4503: 4499: 4497: 4494: 4492: 4489: 4487: 4484: 4482: 4479: 4478: 4476: 4474:Organizations 4472: 4466: 4463: 4461: 4458: 4456: 4453: 4451: 4448: 4446: 4445:Postgenderism 4443: 4441: 4438: 4436: 4433: 4431: 4428: 4426: 4423: 4422: 4420: 4416: 4410: 4407: 4405: 4402: 4401: 4399: 4395: 4391: 4390:Transhumanism 4384: 4379: 4377: 4372: 4370: 4365: 4364: 4361: 4347: 4344: 4343: 4342: 4339: 4337: 4334: 4332: 4329: 4327: 4326:Transhumanism 4324: 4322: 4319: 4317: 4314: 4313: 4311: 4307: 4301: 4298: 4296: 4293: 4292: 4290: 4286: 4279: 4275: 4273: 4272: 4268: 4266: 4265: 4261: 4260: 4258: 4254: 4248: 4245: 4243: 4240: 4238: 4235: 4233: 4230: 4228: 4225: 4223: 4220: 4218: 4215: 4214: 4212: 4208: 4202: 4199: 4197: 4194: 4193: 4191: 4189:Organizations 4187: 4181: 4178: 4176: 4173: 4171: 4168: 4166: 4163: 4161: 4158: 4156: 4153: 4151: 4148: 4146: 4143: 4141: 4138: 4136: 4133: 4131: 4128: 4126: 4123: 4121: 4118: 4117: 4115: 4111: 4107: 4100: 4095: 4093: 4088: 4086: 4081: 4080: 4077: 4065: 4064: 4060: 4058: 4057: 4053: 4052: 4050: 4046: 4040: 4037: 4035: 4032: 4030: 4027: 4025: 4022: 4021: 4019: 4017:Organizations 4015: 4009: 4006: 4004: 4001: 3999: 3996: 3995: 3993: 3989: 3985: 3984: 3976: 3971: 3969: 3964: 3962: 3957: 3956: 3953: 3943: 3933: 3927: 3924: 3922: 3921: 3917: 3915: 3914: 3910: 3908: 3907: 3906:The Precipice 3903: 3901: 3900: 3896: 3894: 3891: 3889: 3888: 3884: 3882: 3879: 3878: 3876: 3872: 3866: 3863: 3861: 3858: 3856: 3855:Frank Wilczek 3853: 3851: 3848: 3846: 3843: 3841: 3838: 3836: 3833: 3831: 3828: 3826: 3823: 3821: 3818: 3816: 3813: 3811: 3808: 3806: 3803: 3801: 3800:Dan Hendrycks 3798: 3796: 3793: 3791: 3788: 3786: 3783: 3781: 3778: 3776: 3773: 3771: 3770:Yoshua Bengio 3768: 3766: 3763: 3761: 3758: 3757: 3755: 3751: 3745: 3742: 3740: 3737: 3735: 3732: 3730: 3727: 3725: 3722: 3720: 3717: 3715: 3712: 3710: 3707: 3705: 3702: 3700: 3697: 3695: 3692: 3690: 3687: 3685: 3682: 3680: 3677: 3676: 3674: 3672:Organizations 3670: 3664: 3661: 3659: 3656: 3654: 3651: 3649: 3646: 3644: 3641: 3639: 3636: 3634: 3631: 3629: 3626: 3624: 3621: 3619: 3616: 3614: 3611: 3609: 3606: 3604: 3601: 3599: 3596: 3594: 3591: 3589: 3586: 3584: 3581: 3580: 3578: 3574: 3570: 3566: 3559: 3554: 3552: 3547: 3545: 3540: 3539: 3536: 3522: 3519: 3517: 3516:Risk analysis 3514: 3512: 3509: 3507: 3504: 3502: 3499: 3498: 3491: 3489: 3488: 3483: 3477: 3476: 3473: 3467: 3464: 3462: 3461:Social crisis 3459: 3457: 3454: 3452: 3449: 3447: 3444: 3442: 3439: 3437: 3434: 3432: 3429: 3427: 3424: 3422: 3419: 3417: 3414: 3413: 3411: 3407: 3401: 3398: 3396: 3393: 3391: 3388: 3386: 3383: 3382: 3380: 3378:Organizations 3376: 3368: 3365: 3364: 3363: 3360: 3358: 3355: 3351: 3348: 3347: 3346: 3343: 3341: 3338: 3334: 3331: 3329: 3326: 3325: 3324: 3321: 3319: 3316: 3315: 3313: 3309: 3303: 3302:World to come 3300: 3298: 3295: 3291: 3288: 3286: 3283: 3282: 3281: 3278: 3276: 3273: 3271: 3268: 3264: 3261: 3259: 3256: 3254: 3251: 3250: 3249: 3248:Millennialism 3246: 3244: 3241: 3237: 3236:Messianic Age 3234: 3233: 3232: 3229: 3227: 3224: 3222: 3221:Gog and Magog 3219: 3217: 3214: 3212: 3211:Earth Changes 3209: 3207: 3204: 3202: 3199: 3197: 3194: 3192: 3189: 3187: 3184: 3182: 3179: 3177: 3174: 3173: 3171: 3167: 3159: 3156: 3155: 3154: 3151: 3149: 3146: 3140: 3137: 3135: 3132: 3130: 3127: 3126: 3125: 3122: 3118: 3115: 3113: 3110: 3108: 3105: 3103: 3100: 3098: 3095: 3093: 3090: 3088: 3085: 3083: 3080: 3079: 3078: 3075: 3071: 3068: 3066: 3063: 3059: 3056: 3055: 3054: 3051: 3049: 3048:New Jerusalem 3046: 3044: 3041: 3039: 3036: 3030: 3027: 3025: 3024:War in Heaven 3022: 3020: 3019:Two witnesses 3017: 3015: 3012: 3010: 3007: 3005: 3002: 3000: 2997: 2995: 2992: 2990: 2987: 2986: 2985: 2982: 2981: 2980: 2977: 2975: 2972: 2968: 2965: 2963: 2960: 2959: 2958: 2955: 2953: 2950: 2948: 2945: 2943: 2940: 2936: 2933: 2932: 2931: 2928: 2926: 2923: 2922: 2921: 2918: 2916: 2913: 2909: 2906: 2904: 2901: 2900: 2899: 2896: 2894: 2891: 2890: 2889: 2888:Second Coming 2886: 2884: 2881: 2877: 2874: 2872: 2869: 2868: 2867: 2864: 2860: 2857: 2855: 2852: 2851: 2850: 2847: 2846: 2844: 2842: 2838: 2832: 2829: 2827: 2824: 2822: 2819: 2817: 2814: 2812: 2809: 2805: 2802: 2800: 2797: 2793: 2790: 2789: 2788: 2785: 2783: 2780: 2778: 2775: 2774: 2773: 2770: 2768: 2765: 2763: 2760: 2758: 2755: 2753: 2750: 2748: 2745: 2743: 2740: 2738: 2735: 2733: 2730: 2728: 2725: 2723: 2720: 2719: 2717: 2713: 2703: 2700: 2698: 2695: 2693: 2690: 2688: 2685: 2683: 2680: 2678: 2675: 2673: 2670: 2666: 2663: 2661: 2658: 2656: 2653: 2652: 2651: 2648: 2644: 2641: 2639: 2636: 2635: 2634: 2631: 2630: 2628: 2624: 2618: 2615: 2613: 2610: 2608: 2605: 2603: 2600: 2598: 2595: 2593: 2590: 2589: 2587: 2585: 2581: 2578: 2574: 2562: 2559: 2558: 2557: 2554: 2552: 2549: 2548: 2546: 2544: 2540: 2534: 2531: 2529: 2526: 2524: 2521: 2517: 2514: 2513: 2512: 2509: 2507: 2504: 2502: 2499: 2497: 2494: 2492: 2489: 2487: 2484: 2482: 2479: 2477: 2474: 2470: 2467: 2465: 2462: 2461: 2460: 2457: 2455: 2452: 2450: 2447: 2445: 2442: 2440: 2437: 2435: 2432: 2430: 2427: 2425: 2422: 2420: 2417: 2415: 2412: 2410: 2407: 2403: 2400: 2399: 2398: 2395: 2393: 2390: 2388: 2387:Deforestation 2385: 2383: 2380: 2378: 2375: 2373: 2370: 2366: 2363: 2362: 2361: 2358: 2356: 2353: 2352: 2350: 2348: 2344: 2341: 2339: 2335: 2329: 2328:World War III 2326: 2324: 2321: 2317: 2314: 2312: 2309: 2307: 2304: 2303: 2302: 2299: 2297: 2294: 2292: 2289: 2287: 2284: 2280: 2277: 2275: 2272: 2271: 2270: 2267: 2265: 2262: 2260: 2257: 2256: 2254: 2250: 2244: 2243:Transhumanism 2241: 2237: 2234: 2232: 2229: 2227: 2224: 2223: 2222: 2218: 2215: 2211: 2208: 2206: 2203: 2202: 2201: 2198: 2195: 2192: 2188: 2185: 2183: 2180: 2178: 2175: 2173: 2170: 2168: 2165: 2164: 2163: 2160: 2156: 2153: 2152: 2151: 2148: 2146: 2143: 2141: 2138: 2134: 2131: 2129: 2126: 2124: 2121: 2120: 2119: 2116: 2114: 2111: 2110: 2108: 2106:Technological 2104: 2096: 2093: 2092: 2091: 2088: 2086: 2083: 2082: 2079: 2075: 2068: 2063: 2061: 2056: 2054: 2049: 2048: 2045: 2033: 2030: 2029: 2027: 2023: 2017: 2016: 2012: 2010: 2009: 2005: 2003: 2002: 2001:The Precipice 1998: 1996: 1995: 1991: 1989: 1988: 1984: 1982: 1981: 1977: 1975: 1974: 1970: 1968: 1967: 1963: 1961: 1960: 1956: 1954: 1953: 1949: 1948: 1946: 1942: 1936: 1933: 1931: 1928: 1926: 1923: 1921: 1918: 1916: 1913: 1911: 1908: 1906: 1903: 1901: 1898: 1896: 1893: 1891: 1890:Global health 1888: 1886: 1883: 1881: 1878: 1876: 1873: 1871: 1870:Cultured meat 1868: 1866: 1863: 1861: 1858: 1857: 1855: 1851: 1845: 1842: 1840: 1837: 1835: 1832: 1830: 1827: 1825: 1822: 1820: 1817: 1815: 1812: 1810: 1807: 1805: 1802: 1800: 1797: 1795: 1794:Good Ventures 1792: 1790: 1787: 1785: 1782: 1780: 1777: 1775: 1772: 1770: 1767: 1765: 1762: 1760: 1757: 1755: 1752: 1750: 1747: 1745: 1742: 1740: 1737: 1735: 1732: 1730: 1727: 1725: 1722: 1720: 1717: 1715: 1712: 1710: 1709:Animal Ethics 1707: 1705: 1702: 1699: 1697: 1694: 1692: 1689: 1688: 1686: 1684:Organizations 1682: 1676: 1673: 1671: 1668: 1666: 1663: 1661: 1658: 1656: 1653: 1651: 1648: 1646: 1643: 1641: 1638: 1636: 1633: 1631: 1628: 1626: 1623: 1621: 1618: 1616: 1613: 1612: 1610: 1606: 1600: 1597: 1595: 1592: 1590: 1587: 1585: 1582: 1580: 1577: 1575: 1572: 1570: 1567: 1565: 1562: 1560: 1557: 1555: 1552: 1550: 1547: 1545: 1542: 1540: 1537: 1535: 1532: 1530: 1527: 1526: 1524: 1520: 1516: 1509: 1504: 1502: 1497: 1495: 1490: 1489: 1486: 1474: 1473: 1469: 1467: 1466: 1465:The Precipice 1462: 1460: 1459: 1455: 1453: 1452: 1448: 1446: 1445: 1441: 1440: 1438: 1434: 1428: 1425: 1423: 1420: 1418: 1415: 1413: 1410: 1408: 1407:Reversal test 1405: 1403: 1400: 1398: 1395: 1393: 1390: 1388: 1385: 1384: 1382: 1378: 1372: 1369: 1367: 1364: 1362: 1359: 1357: 1354: 1352: 1349: 1347: 1344: 1343: 1341: 1337: 1333: 1326: 1321: 1319: 1314: 1312: 1307: 1306: 1303: 1295: 1290: 1289: 1268: 1264: 1258: 1242: 1238: 1232: 1217: 1210: 1203: 1188: 1187:The Spectator 1184: 1177: 1162: 1158: 1151: 1136: 1129: 1122: 1107: 1103: 1096: 1081: 1077: 1070: 1055: 1051: 1044: 1042: 1026: 1022: 1018: 1014: 1009: 1004: 1000: 996: 992: 985: 969: 965: 961: 954: 946: 943:(July 2018). 942: 936: 921: 917: 910: 895: 891: 884: 865: 858: 851: 836: 835: 830: 823: 815: 809: 793: 787: 771: 767: 763: 762:"Support FHI" 757: 741: 737: 736:Aeon Magazine 733: 726: 724: 707: 703: 699: 693: 678: 674: 668: 652: 648: 644: 638: 636: 631: 620: 617: 615: 612: 610: 607: 605: 602: 601: 591: 590: 585: 583: 582:0-415-93858-9 579: 575: 574: 569: 567: 566:0-19-929972-2 563: 559: 558: 553: 549: 547: 543: 539: 538: 533: 529: 527: 526:0-415-93858-9 523: 519: 518: 513: 510: 508: 504: 500: 499: 494: 491: 490: 484: 482: 481:systemic risk 479:to study the 478: 474: 470: 464: 462: 458: 454: 450: 446: 442: 438: 428: 426: 422: 421:Fermi paradox 417: 415: 411: 406: 404: 397: 387: 385: 384: 378: 376: 372: 368: 364: 360: 356: 352: 348: 344: 340: 335: 333: 329: 325: 321: 317: 313: 312:impact events 309: 305: 302:'s 2008 book 301: 296: 294: 290: 286: 280: 270: 268: 263: 261: 260: 255: 251: 247: 243: 238: 236: 232: 228: 217: 215: 210: 208: 204: 200: 196: 192: 188: 183: 181: 177: 173: 169: 165: 161: 157: 153: 149: 145: 135: 131: 127: 124: 120: 117: 111: 108: 105: 99: 96: 92: 89: 85: 81: 77: 63: 59: 45: 41: 37: 32: 26: 22: 4629:Vernor Vinge 4609:David Pearce 4594:Hans Moravec 4584:Ray Kurzweil 4574:James Hughes 4569:Robin Hanson 4544:Ben Goertzel 4524:Nick Bostrom 4500: 4495: 4435:Extropianism 4321:Nanomedicine 4269: 4262: 4237:Ralph Merkle 4200: 4140:Nanorobotics 4061: 4054: 4028: 4003:Robin Hanson 3981: 3918: 3911: 3904: 3897: 3885: 3845:Jaan Tallinn 3785:Eric Drexler 3775:Nick Bostrom 3708: 3588:AI alignment 3478: 3421:Cyberwarfare 3389: 3139:Third Temple 2994:Lake of fire 2804:Rogue planet 2772:Impact event 2762:Proton decay 2715:Astronomical 2665:Bioterrorism 2511:Supervolcano 2409:Flood basalt 2355:Anoxic event 2264:Collapsology 2252:Sociological 2123:Cyberwarfare 2013: 2006: 1999: 1992: 1985: 1978: 1971: 1964: 1957: 1950: 1769:GiveDirectly 1753: 1691:80,000 Hours 1665:Peter Singer 1660:Derek Parfit 1650:Yew-Kwang Ng 1625:Nick Bostrom 1470: 1463: 1456: 1449: 1442: 1397:Great Filter 1356:Robin Hanson 1346:Nick Bostrom 1331: 1271:. Retrieved 1266: 1257: 1245:. Retrieved 1241:the original 1231: 1219:. Retrieved 1215: 1202: 1190:. Retrieved 1186: 1176: 1164:. Retrieved 1160: 1150: 1138:. Retrieved 1134: 1121: 1109:. Retrieved 1105: 1095: 1083:. Retrieved 1079: 1069: 1057:. Retrieved 1054:The Atlantic 1053: 1028:. Retrieved 998: 994: 984: 972:. Retrieved 970:(3): 308–314 967: 963: 953: 935: 923:. Retrieved 919: 909: 897:. Retrieved 893: 883: 871:. Retrieved 864:the original 850: 838:. Retrieved 832: 822: 796:. Retrieved 786: 774:. Retrieved 765: 756: 744:. Retrieved 740:the original 735: 710:. Retrieved 706:the original 701: 692: 680:. Retrieved 676: 667: 655:. Retrieved 651:the original 646: 588: 572: 555: 535: 515: 512:Nick Bostrom 496: 465: 445:gene therapy 434: 425:Great Filter 418: 407: 399: 381: 379: 336: 324:solar flares 303: 298:Bostrom and 297: 282: 264: 257: 253: 245: 239: 223: 211: 184: 168:Nick Bostrom 147: 143: 141: 107:Nick Bostrom 87:Headquarters 25: 4539:David Gobel 4440:Immortalism 4170:Utility fog 3850:Max Tegmark 3835:Martin Rees 3643:Longtermism 3603:AI takeover 3497:Categories 3466:Survivalism 3153:Zoroastrian 3009:Seven seals 3004:Seven bowls 2930:Historicism 2826:Solar flare 2702:Overfishing 2677:Defaunation 2464:coral reefs 2226:AI takeover 2145:Nanoweapons 2133:Cybergeddon 2118:Cyberattack 1853:Focus areas 1744:Faunalytics 1608:Key figures 1569:Longtermism 1155:Ord, Toby. 698:"About FHI" 320:cosmic rays 4677:Categories 4404:Transhuman 3815:Shane Legg 3790:Sam Harris 3765:Sam Altman 3704:EleutherAI 3426:Depression 3416:Ransomware 3231:Messianism 3201:Armageddon 3186:Apocalypse 2974:Antichrist 2962:Man of sin 2859:Three Ages 2722:Big Crunch 2584:Extinction 2576:Biological 2338:Ecological 2210:Strangelet 1944:Literature 1620:Liv Boeree 1192:18 October 1166:18 October 626:References 507:1526600218 328:supernovae 233:, and the 71:2024-04-16 4604:Elon Musk 4502:LessWrong 4486:Humanity+ 4397:Overviews 3983:LessWrong 3830:Huw Price 3820:Elon Musk 3724:Humanity+ 3598:AI safety 3311:Fictional 3158:Saoshyant 3043:New Earth 3014:The Beast 2947:Preterism 2920:Christian 2876:Kali Yuga 2821:Micronova 2816:Hypernova 2682:Dysgenics 2523:Verneshot 2429:Hypercane 2172:Dead Hand 1670:Cari Tuna 1427:Singleton 1003:CiteSeerX 834:404 Media 441:bioethics 332:pandemics 265:In 2018, 195:Elon Musk 150:) was an 61:Dissolved 43:Formation 4662:Category 4599:Max More 4418:Currents 4346:Societal 4331:Cryonics 4175:Ecophagy 4155:Gray goo 4113:Concepts 3942:Category 3810:Bill Joy 3576:Concepts 3451:Pandemic 3436:Epidemic 3431:Droughts 3285:Prewrath 3216:End time 3082:Al-Qa'im 2967:Katechon 2952:2 Esdras 2942:Idealism 2925:Futurism 2854:Maitreya 2849:Buddhist 2692:Pandemic 2140:Gray goo 1774:GiveWell 1655:Toby Ord 1522:Concepts 1380:Concepts 1361:Toby Ord 1273:31 March 1247:31 March 1221:31 March 1140:31 March 1111:31 March 1085:29 March 1059:29 March 1030:31 March 1025:15860897 995:Utilitas 974:31 March 925:29 March 920:BBC News 899:31 March 873:31 March 840:17 April 808:cite web 798:17 April 770:Archived 768:. 2021. 746:28 March 712:28 March 682:28 March 657:28 March 597:See also 576:, 2010. 560:, 2011. 540:, 2011. 520:, 2014. 501:, 2020. 493:Toby Ord 365:and the 180:Toby Ord 178:founder 162:and the 102:Director 4559:FM-2030 4039:MetaMed 3511:Hazards 3409:General 3280:Rapture 3129:Messiah 3117:Sufyani 3107:Israfil 3077:Islamic 2915:Messiah 2893:1 Enoch 2727:Big Rip 2439:Ecocide 2434:Ice age 776:23 July 732:"Omens" 673:"Staff" 592:, 2008. 220:History 129:Website 95:England 79:Purpose 69: ( 51: ( 4517:People 4210:People 3991:People 3753:People 3744:OpenAI 3441:Famine 3367:Zombie 3169:Others 3124:Jewish 3102:Dajjal 2984:Events 2898:Daniel 2799:winter 2626:Others 2516:winter 2316:winter 2311:famine 2306:cobalt 2025:Events 1339:People 1106:Bustle 1023:  1005:  580:  564:  544:  524:  505:  473:biases 459:, and 357:, and 326:, and 205:, and 197:, the 91:Oxford 4288:Other 4256:Works 4048:Works 3874:Other 3567:from 3456:Riots 3148:Norse 3112:Mahdi 2871:Kalki 2866:Hindu 2196:(EMP) 1436:Works 1212:(PDF) 1131:(PDF) 1021:S2CID 894:Wired 867:(PDF) 860:(PDF) 477:Amlin 191:Amlin 1275:2014 1249:2014 1223:2014 1194:2020 1168:2020 1142:2014 1113:2014 1087:2014 1061:2014 1032:2014 976:2014 927:2014 901:2014 875:2014 842:2024 814:link 800:2024 778:2022 748:2014 714:2014 684:2014 659:2014 578:ISBN 562:ISBN 542:ISBN 522:ISBN 503:ISBN 471:and 455:and 349:and 174:and 142:The 53:2005 46:2005 3583:AGI 1013:doi 216:". 148:FHI 4679:: 2219:/ 1265:. 1214:. 1185:. 1159:. 1133:. 1104:. 1078:. 1052:. 1040:^ 1019:. 1011:. 999:15 997:. 993:. 968:15 966:. 962:. 918:. 892:. 831:. 810:}} 806:{{ 764:. 734:. 722:^ 700:. 675:. 645:. 634:^ 554:: 534:: 514:: 495:: 463:. 451:, 447:, 416:. 373:, 353:, 345:, 322:, 318:, 310:, 262:. 209:. 201:, 193:, 182:. 121:, 93:, 4382:e 4375:t 4368:v 4280:" 4276:" 4098:e 4091:t 4084:v 3974:e 3967:t 3960:v 3557:e 3550:t 3543:v 2066:e 2059:t 2052:v 1507:e 1500:t 1493:v 1324:e 1317:t 1310:v 1277:. 1251:. 1225:. 1196:. 1170:. 1144:. 1115:. 1089:. 1063:. 1034:. 1015:: 978:. 947:. 929:. 903:. 877:. 844:. 816:) 802:. 780:. 750:. 716:. 686:. 661:. 146:( 73:) 55:) 23:.

Index

Future of Life Institute
Future of Humanity Institute logo
Oxford
England
Nick Bostrom
Faculty of Philosophy
University of Oxford
futureofhumanityinstitute.org
interdisciplinary
University of Oxford
Faculty of Philosophy
Oxford Martin School
Nick Bostrom
Anders Sandberg
Giving What We Can
Toby Ord
Centre for Effective Altruism
Amlin
Elon Musk
European Research Council
Future of Life Institute
Leverhulme Trust
Faculty of Philosophy
World Economic Forum
Macarthur Foundation
World Health Organization
Julian Savulescu
artificial intelligence
Superintelligence: Paths, Dangers, Strategies
Open Philanthropy

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑