{"id":46296,"date":"2023-03-22T14:37:08","date_gmt":"2023-03-22T14:37:08","guid":{"rendered":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/staging-environm\/?post_type=open-letter&#038;p=46296"},"modified":"2025-06-04T12:34:02","modified_gmt":"2025-06-04T12:34:02","slug":"pause-giant-ai-experiments","status":"publish","type":"open-letter","link":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/","title":{"rendered":"Pause Giant AI Experiments: An Open Letter"},"content":{"rendered":"<p>AI systems with human-competitive intelligence can pose profound risks to society and humanity, as shown by extensive research<sup id=\"ref1\">[1]<\/sup> and acknowledged by top AI labs.<sup id=\"ref2\">[2]<\/sup> As stated in the widely-endorsed <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/ai-principles\/\">Asilomar AI Principles<\/a>, <em>Advanced AI could represent a profound change in the history of life on Earth, and should be planned for and managed with commensurate care and resources<\/em>. Unfortunately, this level of planning and management is not happening, even though recent months have seen AI labs locked in an out-of-control race to develop and deploy ever more powerful digital minds that no one \u2013 not even their creators \u2013 can understand, predict, or reliably control.<\/p>\n<p>Contemporary AI systems are now becoming human-competitive at general tasks,<sup id=\"ref3\">[3]<\/sup> and we must ask ourselves: <em>Should<\/em> we let machines flood our information channels with propaganda and untruth?\u00a0<em>Should<\/em> we automate away all the jobs, including the fulfilling ones? <em>Should<\/em>\u00a0we develop nonhuman minds that might eventually outnumber, outsmart,\u00a0obsolete and replace\u00a0us? <em>Should<\/em> we risk loss of control of our civilization? Such decisions must not be delegated to unelected tech leaders.\u00a0<strong>Powerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable.<\/strong> This confidence must be well justified and increase with the magnitude of a system&#8217;s potential effects. OpenAI&#8217;s <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/openai.com\/blog\/planning-for-agi-and-beyond\" target=\"_blank\" rel=\"noopener\">recent statement regarding artificial general intelligence<\/a>, states that <em>&#8220;At some point, it may be important to get independent review before starting to train future systems, and for the most advanced efforts to agree to limit the rate of growth of compute used for creating new models.&#8221;<\/em> We agree. That point is now.<\/p>\n<p>Therefore, <strong>we\u00a0call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4<\/strong>. This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.<\/p>\n<p>AI labs and independent experts should use this pause to jointly develop and implement a set of shared safety protocols for advanced AI design and development that are rigorously audited and overseen by independent outside experts. These protocols should ensure that systems adhering to them are safe beyond a reasonable doubt.<sup id=\"ref4\">[4]<\/sup> This does <em>not<\/em> mean a pause on AI development in general, merely a stepping back from the dangerous race to ever-larger unpredictable black-box models with emergent capabilities.<\/p>\n<p>AI research and development should be refocused on making today&#8217;s powerful, state-of-the-art systems more accurate, safe, interpretable, transparent, robust, aligned, trustworthy, and loyal.<\/p>\n<p>In parallel, AI developers must work with policymakers to dramatically accelerate development of robust AI governance systems. These should at a minimum include: new and capable regulatory authorities dedicated to AI; oversight and tracking of highly capable AI systems and large pools of computational capability; provenance and watermarking systems to help distinguish real from synthetic and to track model leaks; a robust auditing and certification ecosystem; liability for AI-caused harm; robust public funding for technical AI safety research; and well-resourced institutions for coping with the dramatic economic and political disruptions (especially to democracy) that AI will cause.<\/p>\n<p>Humanity can enjoy a flourishing future with AI. Having succeeded in creating powerful AI systems, we can now enjoy an &#8220;AI summer&#8221; in which we reap the rewards, engineer these systems for the clear benefit of all, and give society a chance to adapt. Society has hit pause on other technologies with potentially catastrophic effects on society.<sup id=\"ref5\">[5]<\/sup>\u00a0\u00a0We can do so here.\u00a0Let&#8217;s enjoy a long AI summer, not rush unprepared into a fall.<\/p>\n<p><em>We have prepared some FAQs in response to questions and discussion in the media and elsewhere. You can find them <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/ai\/faqs-about-flis-open-letter-calling-for-a-pause-on-giant-ai-experiments\/\">here<\/a>.<\/em><\/p>\n<p><em>In addition to this open letter, we have published a set of policy recommendations which can be found here:<\/em><\/p>\n<div class=\"pad--s border--thin-shade-light rounded--s gap--m flex--row justify-content--between margin-top--s\">\n<div>\n<h4>Policymaking in the Pause<\/h4>\n<p class=\"text--shade-medium\">12th April 2023<\/p>\n<\/div>\n<p><a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/document\/policymaking-in-the-pause\/\" rel=\"noopener\">View paper<\/a><\/p>\n<\/div>\n<p><em>This open letter is available in <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/stoppons-les-experimentations-sur-les-ia-une-lettre-ouverte\/\">French<\/a>, <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/%d8%a3%d9%88%d9%82%d9%81%d9%88%d8%a7-%d8%aa%d8%ac%d8%a7%d8%b1%d8%a8-%d8%a7%d9%84%d8%b0%d9%83%d8%a7%d8%a1-%d8%a7%d9%84%d8%a7%d8%b5%d8%b7%d9%86%d8%a7%d8%b9%d9%8a-%d8%a7%d9%84%d8%b9%d9%85%d9%84%d8%a7\/\">Arabic<\/a>, and <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/80000horas.com.br\/pause-os-experimentos-de-ia-gigantes-uma-carta-aberta-do-future-of-life-institute\/\" target=\"_blank\" rel=\"noopener\">Brazilian Portuguese<\/a>. You can also <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/fli_pause-giant-ai-experiments_an-open-letter\/\">download this open letter as a PDF<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>We call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.<\/p>\n","protected":false},"author":1,"featured_media":47718,"template":"","meta":{"spt_transcript":"","_members_access_role":[],"_members_access_error":"","_links_to":"","_links_to_target":""},"categories":[34,35],"tags":[84,67,62,66,194],"project_thread":[212,428],"cause-area":[111],"fli-area":[],"class_list":["post-46296","open-letter","type-open-letter","status-publish","has-post-thumbnail","hentry","category-ai","category-featured","tag-agi","tag-ai","tag-existential-risk","tag-global-catastrophe","tag-takeoff","project_thread-pause-ai-experiments-letter","project_thread-take-action","cause-area-artificial-intelligence"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.7 - https:\/\/proxy.goincop1.workers.dev:443\/https\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Pause Giant AI Experiments: An Open Letter - Future of Life Institute<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Pause Giant AI Experiments: An Open Letter - Future of Life Institute\" \/>\n<meta property=\"og:description\" content=\"We call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/\" \/>\n<meta property=\"og:site_name\" content=\"Future of Life Institute\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/www.facebook.com\/futureoflifeinstitute\" \/>\n<meta property=\"article:modified_time\" content=\"2025-06-04T12:34:02+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-content\/uploads\/2023\/03\/Open-letter-mockup-4.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1367\" \/>\n\t<meta property=\"og:image:height\" content=\"768\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-content\/uploads\/2023\/03\/Open-letter-mockup-4.jpg\" \/>\n<meta name=\"twitter:site\" content=\"@FLIxrisk\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/futureoflife.org\\\/open-letter\\\/pause-giant-ai-experiments\\\/\",\"url\":\"https:\\\/\\\/futureoflife.org\\\/open-letter\\\/pause-giant-ai-experiments\\\/\",\"name\":\"Pause Giant AI Experiments: An Open Letter - Future of Life Institute\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/futureoflife.org\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/futureoflife.org\\\/open-letter\\\/pause-giant-ai-experiments\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/futureoflife.org\\\/open-letter\\\/pause-giant-ai-experiments\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/futureoflife.org\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/Open-letter-mockup-4.jpg\",\"datePublished\":\"2023-03-22T14:37:08+00:00\",\"dateModified\":\"2025-06-04T12:34:02+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/futureoflife.org\\\/open-letter\\\/pause-giant-ai-experiments\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/futureoflife.org\\\/open-letter\\\/pause-giant-ai-experiments\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/futureoflife.org\\\/open-letter\\\/pause-giant-ai-experiments\\\/#primaryimage\",\"url\":\"https:\\\/\\\/futureoflife.org\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/Open-letter-mockup-4.jpg\",\"contentUrl\":\"https:\\\/\\\/futureoflife.org\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/Open-letter-mockup-4.jpg\",\"width\":1367,\"height\":768},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/futureoflife.org\\\/open-letter\\\/pause-giant-ai-experiments\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Open Letters\",\"item\":\"https:\\\/\\\/futureoflife.org\\\/open-letter\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Pause Giant AI Experiments: An Open Letter\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/futureoflife.org\\\/#website\",\"url\":\"https:\\\/\\\/futureoflife.org\\\/\",\"name\":\"Future of Life Institute\",\"description\":\"Preserving the long-term future of life.\",\"publisher\":{\"@id\":\"https:\\\/\\\/futureoflife.org\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/futureoflife.org\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/futureoflife.org\\\/#organization\",\"name\":\"Future of Life Institute\",\"url\":\"https:\\\/\\\/futureoflife.org\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/futureoflife.org\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/futureoflife.org\\\/wp-content\\\/uploads\\\/2015\\\/10\\\/fli_logo_white.png\",\"contentUrl\":\"https:\\\/\\\/futureoflife.org\\\/wp-content\\\/uploads\\\/2015\\\/10\\\/fli_logo_white.png\",\"width\":667,\"height\":454,\"caption\":\"Future of Life Institute\"},\"image\":{\"@id\":\"https:\\\/\\\/futureoflife.org\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/futureoflifeinstitute\",\"https:\\\/\\\/x.com\\\/FLIxrisk\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Pause Giant AI Experiments: An Open Letter - Future of Life Institute","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/","og_locale":"en_US","og_type":"article","og_title":"Pause Giant AI Experiments: An Open Letter - Future of Life Institute","og_description":"We call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.","og_url":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/","og_site_name":"Future of Life Institute","article_publisher":"https:\/\/proxy.goincop1.workers.dev:443\/https\/www.facebook.com\/futureoflifeinstitute","article_modified_time":"2025-06-04T12:34:02+00:00","og_image":[{"width":1367,"height":768,"url":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-content\/uploads\/2023\/03\/Open-letter-mockup-4.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_image":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-content\/uploads\/2023\/03\/Open-letter-mockup-4.jpg","twitter_site":"@FLIxrisk","schema":{"@context":"https:\/\/proxy.goincop1.workers.dev:443\/https\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/","url":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/","name":"Pause Giant AI Experiments: An Open Letter - Future of Life Institute","isPartOf":{"@id":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/#website"},"primaryImageOfPage":{"@id":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/#primaryimage"},"image":{"@id":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/#primaryimage"},"thumbnailUrl":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-content\/uploads\/2023\/03\/Open-letter-mockup-4.jpg","datePublished":"2023-03-22T14:37:08+00:00","dateModified":"2025-06-04T12:34:02+00:00","breadcrumb":{"@id":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/#primaryimage","url":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-content\/uploads\/2023\/03\/Open-letter-mockup-4.jpg","contentUrl":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-content\/uploads\/2023\/03\/Open-letter-mockup-4.jpg","width":1367,"height":768},{"@type":"BreadcrumbList","@id":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Open Letters","item":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/open-letter\/"},{"@type":"ListItem","position":2,"name":"Pause Giant AI Experiments: An Open Letter"}]},{"@type":"WebSite","@id":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/#website","url":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/","name":"Future of Life Institute","description":"Preserving the long-term future of life.","publisher":{"@id":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/#organization","name":"Future of Life Institute","url":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/#\/schema\/logo\/image\/","url":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-content\/uploads\/2015\/10\/fli_logo_white.png","contentUrl":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-content\/uploads\/2015\/10\/fli_logo_white.png","width":667,"height":454,"caption":"Future of Life Institute"},"image":{"@id":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/proxy.goincop1.workers.dev:443\/https\/www.facebook.com\/futureoflifeinstitute","https:\/\/proxy.goincop1.workers.dev:443\/https\/x.com\/FLIxrisk"]}]}},"meta_box":{"open_letter_status":"1","open_letter_signatories_count":"31810","open_letter_wsform_id":"[ws_form id=\"13\"]","open_letter_hide_signatories_count":"","open_letter_hide_date":"0","open_letter_show_media_mentions":"1","endnotes":"<div class=\"footnote flex--row gap--s\">\n<p id=\"fn1\" class=\"footnote-number\">[1]<\/p>\n<div class=\"footnote-content\">\n<p>Bender, E. M., Gebru, T., McMillan-Major, A., &amp; Shmitchell, S. (2021, March). <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/dl.acm.org\/doi\/10.1145\/3442188.3445922\" target=\"_blank\" rel=\"noopener\">On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?\ud83e\udd9c<\/a>. In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency (pp. 610-623).<\/p>\n<p>Bostrom, N. (2016). Superintelligence. Oxford University Press.<\/p>\n<p>Bucknall, B. S., &amp; Dori-Hacohen, S. (2022, July). <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/arxiv.org\/abs\/2209.10604\" target=\"_blank\" rel=\"noopener\">Current and near-term AI as a potential existential risk factor.<\/a> In\u00a0<i>Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society<\/i> (pp. 119-129).<\/p>\n<p>Carlsmith, J. (2022). <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/arxiv.org\/abs\/2206.13353\" target=\"_blank\" rel=\"noopener\">Is Power-Seeking AI an Existential Risk?<\/a>. arXiv preprint arXiv:2206.13353.<\/p>\n<p>Christian, B. (2020). The Alignment Problem: Machine Learning and human values. Norton &amp; Company.<\/p>\n<p>Cohen, M. et al. (2022). <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/ojs.aaai.org\/aimagazine\/index.php\/aimagazine\/article\/view\/15084\" target=\"_blank\" rel=\"noopener\">Advanced Artificial Agents Intervene in the Provision of Reward.<\/a>\u00a0<i>AI Magazine<\/i>,\u00a0<i>43<\/i>(3) (pp. 282-293).<\/p>\n<p>Eloundou, T., et al. (2023). <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/arxiv.org\/abs\/2303.10130\" target=\"_blank\" rel=\"noopener\">GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models.<\/a><\/p>\n<p>Hendrycks, D., &amp; Mazeika, M. (2022). <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/arxiv.org\/abs\/2206.05862\" target=\"_blank\" rel=\"noopener\">X-risk Analysis for AI Research<\/a>. arXiv preprint arXiv:2206.05862.<\/p>\n<p>Ngo, R. (2022). <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/arxiv.org\/abs\/2209.00626\" target=\"_blank\" rel=\"noopener\">The alignment problem from a deep learning perspective<\/a>. arXiv preprint arXiv:2209.00626.<\/p>\n<p>Russell, S. (2019). Human Compatible: Artificial Intelligence and the Problem of Control. Viking.<\/p>\n<p>Tegmark, M. (2017). Life 3.0: Being Human in the Age of Artificial Intelligence. Knopf.<\/p>\n<p>Weidinger, L. et al (2021). <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/arxiv.org\/abs\/2112.04359\" target=\"_blank\" rel=\"noopener\">Ethical and social risks of harm from language models<\/a>. arXiv preprint arXiv:2112.04359.<\/p>\n<\/div>\n<\/div>\n<div class=\"footnote flex--row gap--s\">\n<p id=\"fn2\" class=\"footnote-number\">[2]<\/p>\n<div class=\"footnote-content\">\n<p>Ordonez, V. et al. (2023, March 16). <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/abcnews.go.com\/Technology\/openai-ceo-sam-altman-ai-reshape-society-acknowledges\/story?id=97897122\" target=\"_blank\" rel=\"noopener\">OpenAI CEO Sam Altman says AI will reshape society, acknowledges risks: 'A little bit scared of this'<\/a>. ABC News.<\/p>\n<p>Perrigo, B. (2023, January 12). <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/time.com\/6246119\/demis-hassabis-deepmind-interview\/\" target=\"_blank\" rel=\"noopener\">DeepMind CEO Demis Hassabis Urges Caution on AI<\/a>. Time.<\/p>\n<\/div>\n<\/div>\n<div class=\"footnote flex--row gap--s\">\n<p id=\"fn3\" class=\"footnote-number\">[3]<\/p>\n<div class=\"footnote-content\">\n<p>Bubeck, S. et al. (2023). <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/arxiv.org\/abs\/2303.12712\" target=\"_blank\" rel=\"noopener\">Sparks of Artificial General Intelligence: Early experiments with GPT-4<\/a>. arXiv:2303.12712.<\/p>\n<p>OpenAI (2023). <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/cdn.openai.com\/papers\/gpt-4.pdf\" target=\"_blank\" rel=\"noopener\">GPT-4 Technical Report<\/a>. arXiv:2303.08774.<\/p>\n<\/div>\n<\/div>\n<div class=\"footnote flex--row gap--s\">\n<p id=\"fn4\" class=\"footnote-number\">[4]<\/p>\n<div class=\"footnote-content\">\n<p class=\"footnote-number\">Ample legal precedent exists \u2013 for example, the widely adopted <a href=\"https:\/\/proxy.goincop1.workers.dev:443\/https\/oecd.ai\/en\/dashboards\/ai-principles\/P8\" target=\"_blank\" rel=\"noopener\">OECD AI Principles<\/a> require that AI systems \"function appropriately and do not pose unreasonable safety risk\".<\/p>\n<\/div>\n<\/div>\n<div class=\"footnote flex--row gap--s\">\n<p id=\"fn5\" class=\"footnote-number\">[5]<\/p>\n<div class=\"footnote-content\">\n<p>Examples include human cloning, human germline modification, gain-of-function research, and eugenics.<\/p>\n<\/div>\n<\/div>\n","signature_display_method":"code_snippet","signatories_list_richtext":"","signatories_code_snippet":"<!-- <div id=\"signatories\"><\/div> -->\r\n<!-- <script src=\"\/wp-content\/uploads\/signatory-scripts\/PTSGPT4_Open_Letter_top_v2.js\"><\/script> -->\r\n\r\n<div id=\"signatories\" class=\"text--line-height-m flex--col gap--xs\"><\/div>\r\n<script src=\"\/wp-content\/uploads\/signatory-scripts\/PTSGPT4_Open_Letter_preview_v2.js\"><\/script>\r\n<script src=\"\/wp-content\/uploads\/signatory-scripts\/PTSGPT4_Open_Letter_signatureCount.js\"><\/script>\r\n<br>\r\n<a href=\"#\" id=\"viewSignatories\" class=\"btn--primary\">View the full list of signatories<\/a>\r\n<p class=\"text--shade-medium text--s\">Attempting to load the full list of signatories on a mobile device or slow internet connection might cause formatting issues.<\/p>\r\n\r\n\r\n<style>\r\n  #signatories {\r\n    opacity: 1;\r\n    transition: opacity 200ms;\r\n  }\r\n  \r\n  #viewSignatories {\r\n    display: block;\r\n  }\r\n  \r\n  #viewSignatories.hidden {\r\n    display: none;\r\n  }\r\n<\/style>\r\n\r\n<script>\r\n  document.getElementById('viewSignatories').addEventListener('click', function(event) {\r\n    event.preventDefault();\r\n    \r\n    var scriptSrc = \"\/wp-content\/uploads\/signatory-scripts\/PTSGPT4_Open_Letter_top_noscript.js\";\r\n    \r\n    fetch(scriptSrc)\r\n      .then(response => response.text())\r\n      .then(scriptContents => {\r\n        var signatoriesDiv = document.getElementById('signatories');\r\n        \r\n        signatoriesDiv.style.opacity = 0;\r\n        \r\n        setTimeout(function() {\r\n          signatoriesDiv.innerHTML = scriptContents;\r\n          \r\n          signatoriesDiv.style.opacity = 1;\r\n          document.getElementById('viewSignatories').classList.add('hidden');\r\n        }, 200);\r\n      })\r\n      .catch(error => console.error('Error loading script:', error));\r\n  });\r\n<\/script>","signatures-open-letters_from":[]},"_links":{"self":[{"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/open-letter\/46296","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/open-letter"}],"about":[{"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/types\/open-letter"}],"author":[{"embeddable":true,"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/users\/1"}],"version-history":[{"count":43,"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/open-letter\/46296\/revisions"}],"predecessor-version":[{"id":118798,"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/open-letter\/46296\/revisions\/118798"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/media\/47718"}],"wp:attachment":[{"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/media?parent=46296"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/categories?post=46296"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/tags?post=46296"},{"taxonomy":"project_thread","embeddable":true,"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/project_thread?post=46296"},{"taxonomy":"cause-area","embeddable":true,"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/cause-area?post=46296"},{"taxonomy":"fli-area","embeddable":true,"href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/futureoflife.org\/wp-json\/wp\/v2\/fli-area?post=46296"}],"curies":[{"name":"wp","href":"https:\/\/proxy.goincop1.workers.dev:443\/https\/api.w.org\/{rel}","templated":true}]}}