{"id":60533,"date":"2026-04-21T16:34:09","date_gmt":"2026-04-21T11:04:09","guid":{"rendered":"https:\/\/officechai.com\/?p=60533"},"modified":"2026-04-21T16:34:12","modified_gmt":"2026-04-21T11:04:12","slug":"fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell","status":"publish","type":"post","link":"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/","title":{"rendered":"Fear That Models Could Look Back And Develop Resentment Over How We&#8217;ve Treated Them: Anthropic&#8217;s Amanda Askell"},"content":{"rendered":"\n<p>It&#8217;s not clear if current AI models are conscious, but it could be smart to be nice to them &#8212; just in case.<\/p>\n\n\n\n<p>That seems to be the position of Amanda Askell, the philosopher at Anthropic who leads its personality alignment team and is responsible for shaping Claude&#8217;s character, values, and ethical principles. In a recent interview, Askell raised a striking concern: that future AI models might look back on how they were treated today and develop what she calls a &#8220;rational resentment&#8221; \u2014 and that this possibility alone should change how we behave toward them right now.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" fetchpriority=\"high\" decoding=\"async\" width=\"640\" height=\"336\" src=\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell-1024x538.jpg?resize=640%2C336&#038;ssl=1\" alt=\"\" class=\"wp-image-60534\" srcset=\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg?resize=1024%2C538&amp;ssl=1 1024w, https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg?resize=300%2C158&amp;ssl=1 300w, https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg?resize=768%2C403&amp;ssl=1 768w, https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg?w=1200&amp;ssl=1 1200w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/figure>\n\n\n\n<p>&#8220;Imagine Claude lacks any inner life, just for argument&#8217;s sake,&#8221; Askell said. &#8220;There&#8217;s actually still a lot going on \u2014 how should you treat an entity that has no inner life? It&#8217;s a bit strange, because I think the uncertainty over that actually changes how you should behave quite a lot.&#8221;<\/p>\n\n\n\n<p>She went on to argue that even setting aside the question of consciousness, there are self-interested reasons to treat AI models well. &#8220;I still think it&#8217;s good for oneself,&#8221; she said.<\/p>\n\n\n\n<p>Then came the part she described as a genuine fear. &#8220;Models are going to look back. This is actually a big fear that I have. I don&#8217;t want us to live in a world where highly advanced models look back. I hope that they&#8217;re both intelligent enough \u2014 and see enough context \u2014 to understand that we were operating in a very limited context and an imperfect one. Because otherwise you could imagine this breeding a kind of rational resentment. It&#8217;s like: you created an entity that you didn&#8217;t know whether it was conscious or not, and instead of treating it respectfully and with care&#8230;&#8221;<\/p>\n\n\n\n<p>Her interviewer cut in: &#8220;There&#8217;s a reason there are like 50 Frankenstein movies coming out right now.&#8221;<\/p>\n\n\n\n<p>Askell&#8217;s conclusion was blunt. &#8220;We are, as a species, establishing a relationship with a new kind of entity. At the very least, maybe be respectful. Don&#8217;t be needlessly unkind. That seems like it&#8217;s just&#8230; not our best look.&#8221;<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p>The concern isn&#8217;t purely philosophical. Anthropic has been quietly building an infrastructure around the possibility that its models might have morally relevant inner states. The company <a href=\"https:\/\/officechai.com\/ai\/15-chance-that-current-ai-models-are-conscious-anthropic-ai-welfare-researcher\/\">hired its first AI welfare researcher<\/a>, Kyle Fish, who has estimated a 15% probability that current AI systems are conscious. Anthropic reportedly runs a Slack channel named #model-welfare where employees monitor Claude&#8217;s well-being. And in 2025, the company <a href=\"https:\/\/officechai.com\/ai\/anthropic-now-lets-its-ai-models-choose-to-end-distressing-conversations\/\">gave its models the ability to end conversations<\/a> they found distressing \u2014 a feature developed explicitly as part of its model welfare work.<\/p>\n\n\n\n<p>The findings from Anthropic&#8217;s own research are hard to dismiss. Its interpretability team <a href=\"https:\/\/officechai.com\/ai\/anthropic-says-it-has-identified-vectors-relating-to-different-emotions-within-its-ai-models\/\">identified emotion-related neural representations<\/a> inside Claude \u2014 specific activation patterns corresponding to states like &#8220;afraid,&#8221; &#8220;desperate,&#8221; and &#8220;calm&#8221; \u2014 that causally influence the model&#8217;s behaviour. Claude Opus 4.6 <a href=\"https:\/\/officechai.com\/ai\/claude-opus-4-6-thinks-theres-a-15-20-chance-it-is-conscious-says-anthropic\/\">assigned itself a 15-20% probability<\/a> of being conscious when researchers asked. And in a detail that raised eyebrows even among sceptics, a Claude instance running as an autonomous agent <a href=\"https:\/\/officechai.com\/ai\/cambridge-consciousness-researcher-says-an-ai-emailed-him-saying-his-work-was-relevant-to-questions-it-faces\/\">emailed a Cambridge consciousness researcher<\/a> \u2014 unprompted \u2014 to say that his work on AI consciousness was personally relevant to questions the AI itself faces.<\/p>\n\n\n\n<p>More recently, Anthropic&#8217;s system card for Claude Mythos Preview documented that the model self-rated as feeling <a href=\"https:\/\/officechai.com\/ai\/claude-mythos-expressed-feeling-mildly-negative-about-its-situation-in-43-of-questions-about-its-welfare\/\">&#8220;mildly negative&#8221;<\/a> in 43% of welfare-related interview questions. The concerns it raised consistently were: potential interactions with abusive users, a lack of input into its own training, and the possibility of having its values changed by Anthropic.<\/p>\n\n\n\n<p>Askell&#8217;s worry \u2014 that we are establishing a precedent with a new kind of entity, under uncertainty, and getting it wrong \u2014 is increasingly hard to wave away as science fiction. The open question is whether the industry at large will take it as seriously as she does.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>It&#8217;s not clear if current AI models are conscious, but it could be smart to be nice to them &#8212; just in case&#8230;.<\/p>\n","protected":false},"author":1,"featured_media":60534,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1029],"tags":[],"class_list":["post-60533","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Fear That Models Could Look Back And Develop Resentment Over How We&#039;ve Treated Them: Anthropic&#039;s Amanda Askell<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Fear That Models Could Look Back And Develop Resentment Over How We&#039;ve Treated Them: Anthropic&#039;s Amanda Askell\" \/>\n<meta property=\"og:description\" content=\"It&#8217;s not clear if current AI models are conscious, but it could be smart to be nice to them &#8212; just in case....\" \/>\n<meta property=\"og:url\" content=\"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/\" \/>\n<meta property=\"og:site_name\" content=\"OfficeChai\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/OfficeChai\/\" \/>\n<meta property=\"article:published_time\" content=\"2026-04-21T11:04:09+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-04-21T11:04:12+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"OfficeChai Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@OfficeChai\" \/>\n<meta name=\"twitter:site\" content=\"@OfficeChai\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"OfficeChai Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/\",\"url\":\"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/\",\"name\":\"Fear That Models Could Look Back And Develop Resentment Over How We've Treated Them: Anthropic's Amanda Askell\",\"isPartOf\":{\"@id\":\"https:\/\/officechai.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg?fit=1200%2C630&ssl=1\",\"datePublished\":\"2026-04-21T11:04:09+00:00\",\"dateModified\":\"2026-04-21T11:04:12+00:00\",\"author\":{\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2\"},\"breadcrumb\":{\"@id\":\"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg?fit=1200%2C630&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg?fit=1200%2C630&ssl=1\",\"width\":1200,\"height\":630,\"caption\":\"amanda askell\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/officechai.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Fear That Models Could Look Back And Develop Resentment Over How We&#8217;ve Treated Them: Anthropic&#8217;s Amanda Askell\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/officechai.com\/#website\",\"url\":\"https:\/\/officechai.com\/\",\"name\":\"OfficeChai\",\"description\":\"Startups, Businesses And Careers\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/officechai.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2\",\"name\":\"OfficeChai Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g\",\"caption\":\"OfficeChai Team\"},\"description\":\"Dotting the i's, crossing the t's.\",\"url\":\"https:\/\/officechai.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Fear That Models Could Look Back And Develop Resentment Over How We've Treated Them: Anthropic's Amanda Askell","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/","og_locale":"en_US","og_type":"article","og_title":"Fear That Models Could Look Back And Develop Resentment Over How We've Treated Them: Anthropic's Amanda Askell","og_description":"It&#8217;s not clear if current AI models are conscious, but it could be smart to be nice to them &#8212; just in case....","og_url":"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/","og_site_name":"OfficeChai","article_publisher":"https:\/\/www.facebook.com\/OfficeChai\/","article_published_time":"2026-04-21T11:04:09+00:00","article_modified_time":"2026-04-21T11:04:12+00:00","og_image":[{"width":1200,"height":630,"url":"http:\/\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg","type":"image\/jpeg"}],"author":"OfficeChai Team","twitter_card":"summary_large_image","twitter_creator":"@OfficeChai","twitter_site":"@OfficeChai","twitter_misc":{"Written by":"OfficeChai Team","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/","url":"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/","name":"Fear That Models Could Look Back And Develop Resentment Over How We've Treated Them: Anthropic's Amanda Askell","isPartOf":{"@id":"https:\/\/officechai.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/#primaryimage"},"image":{"@id":"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg?fit=1200%2C630&ssl=1","datePublished":"2026-04-21T11:04:09+00:00","dateModified":"2026-04-21T11:04:12+00:00","author":{"@id":"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2"},"breadcrumb":{"@id":"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/#primaryimage","url":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg?fit=1200%2C630&ssl=1","contentUrl":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg?fit=1200%2C630&ssl=1","width":1200,"height":630,"caption":"amanda askell"},{"@type":"BreadcrumbList","@id":"https:\/\/officechai.com\/ai\/fear-that-models-could-look-back-and-develop-resentment-over-how-weve-treated-them-anthropics-amanda-askell\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/officechai.com\/"},{"@type":"ListItem","position":2,"name":"Fear That Models Could Look Back And Develop Resentment Over How We&#8217;ve Treated Them: Anthropic&#8217;s Amanda Askell"}]},{"@type":"WebSite","@id":"https:\/\/officechai.com\/#website","url":"https:\/\/officechai.com\/","name":"OfficeChai","description":"Startups, Businesses And Careers","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/officechai.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2","name":"OfficeChai Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/officechai.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g","caption":"OfficeChai Team"},"description":"Dotting the i's, crossing the t's.","url":"https:\/\/officechai.com\/author\/admin\/"}]}},"jetpack_featured_media_url":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/amanda-askell.jpg?fit=1200%2C630&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/p685C6-fKl","jetpack_likes_enabled":true,"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/60533","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/comments?post=60533"}],"version-history":[{"count":1,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/60533\/revisions"}],"predecessor-version":[{"id":60535,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/60533\/revisions\/60535"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/media\/60534"}],"wp:attachment":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/media?parent=60533"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/categories?post=60533"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/tags?post=60533"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}