{"id":57344,"date":"2025-11-19T00:58:06","date_gmt":"2025-11-18T19:28:06","guid":{"rendered":"https:\/\/officechai.com\/?p=57344"},"modified":"2025-11-19T00:58:08","modified_gmt":"2025-11-18T19:28:08","slug":"googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize","status":"publish","type":"post","link":"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/","title":{"rendered":"Google’s Gemini 3 Model Makes 2X Jump Over Previous State-of-the-art on ARC-AGI Prize"},"content":{"rendered":"\n

Google’s Gemini 3 Model has topped most benchmarks<\/a>, but it’s done particularly well on one that tracks how close models are to AGI.<\/p>\n\n\n\n

Gemini 3, the latest iteration of Google’s flagship AI model has achieved a remarkable breakthrough on the ARC-AGI benchmark, effectively doubling the previous state-of-the-art performance. Gemini 3 Pro scored 31.11% on ARC-AGI-2, the benchmark’s more challenging semi-private evaluation, while the Gemini 3 Deep Think preview version reached an impressive 45.14%.<\/p>\n\n\n\n

Understanding the ARC-AGI Prize<\/h2>\n\n\n\n

The Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI) is a benchmark specifically designed to measure progress toward artificial general intelligence. Unlike traditional AI benchmarks that test memorization or pattern matching on tasks similar to training data, ARC-AGI evaluates a model’s ability to perform novel reasoning and abstract thinking\u2014capabilities considered essential for true AGI.<\/p>\n\n\n\n

Created by Fran\u00e7ois Chollet, a researcher at Google and creator of the Keras deep learning framework, the ARC-AGI prize challenges AI systems with visual reasoning puzzles that require understanding core concepts like objects, counting, and basic physics. These tasks are deliberately designed to be easily solvable by humans but extremely difficult for current AI systems, making them a rigorous test of genuine intelligence rather than sophisticated pattern matching.<\/p>\n\n\n\n

The benchmark comes in two versions: ARC-AGI-1, the original evaluation set, and ARC-AGI-2, a newer and more challenging semi-private evaluation designed to prevent overfitting and provide a harder test of reasoning capabilities.<\/p>\n\n\n\n

Gemini 3’s Breakthrough Performance<\/h2>\n\n\n\n

Google’s Gemini 3 has demonstrated unprecedented performance on both versions of the benchmark. On ARC-AGI-1, Gemini 3 Pro achieved a 75% success rate at a cost of $0.49 per task, while the Deep Think variant reached an extraordinary 87.5% accuracy, though at a higher cost of $44.26 per task.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

The results on the more challenging ARC-AGI-2 benchmark are perhaps even more significant. Gemini 3 Pro’s 31.11% score represents approximately double the performance of previous leading models, accomplished at a relatively modest cost of $0.81 per task. The Deep Think preview version, which appears to employ extended reasoning techniques, pushed this even further to 45.14%, establishing a new high-water mark for AI reasoning capabilities.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Fran\u00e7ois Chollet himself acknowledged the significance of these results, stating<\/a>: “Gemini 3 scores 31.1% on ARC-AGI-2. Impressive progress.”<\/p>\n\n\n\n

The Cost-Performance Tradeoff<\/h2>\n\n\n\n

The leaderboard data reveals an interesting dynamic in the cost-performance tradeoff. While the Deep Think variant achieves substantially higher scores, it does so at approximately 100 times the cost per task compared to the standard Pro model. This suggests Google has implemented sophisticated reasoning techniques\u2014possibly involving extended chain-of-thought processing or iterative problem-solving\u2014that require significantly more compute resources.<\/p>\n\n\n\n

For comparison, other leading models on the benchmark include OpenAI’s o3 preview (at various compute levels), Grok 4, and Claude models, but none have matched Gemini 3’s performance on ARC-AGI-2. The achievement represents not just an incremental improvement but a fundamental leap forward in AI reasoning capabilities.<\/p>\n\n\n\n

What This Means for AGI Progress<\/h2>\n\n\n\n

While even Gemini 3 Deep Think’s 45% success rate on ARC-AGI-2 indicates we remain far from human-level performance on these reasoning tasks, the 2X improvement over previous state-of-the-art represents meaningful progress toward artificial general intelligence. The benchmark’s specific focus on novel reasoning\u2014rather than tasks that might benefit from memorization or training data similarity\u2014makes these gains particularly significant for the broader AI research community.<\/p>\n\n\n\n

As the race toward AGI continues to intensify among major AI laboratories, benchmarks like ARC-AGI provide crucial objective measures of progress on the capabilities that matter most: the ability to reason abstractly, adapt to novel situations, and solve problems that weren’t part of training data. Google’s Gemini 3 has set a new standard on this critical dimension of AI capability.<\/p>\n","protected":false},"excerpt":{"rendered":"

Google’s Gemini 3 Model has topped most benchmarks, but it’s done particularly well on one that tracks how close models are to AGI….<\/p>\n","protected":false},"author":1,"featured_media":57345,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1029],"tags":[],"class_list":["post-57344","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai"],"yoast_head":"\nGoogle's Gemini 3 Model Makes 2X Jump Over Previous State-of-the-art on ARC-AGI Prize<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Google's Gemini 3 Model Makes 2X Jump Over Previous State-of-the-art on ARC-AGI Prize\" \/>\n<meta property=\"og:description\" content=\"Google’s Gemini 3 Model has topped most benchmarks, but it’s done particularly well on one that tracks how close models are to AGI....\" \/>\n<meta property=\"og:url\" content=\"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/\" \/>\n<meta property=\"og:site_name\" content=\"OfficeChai\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/OfficeChai\/\" \/>\n<meta property=\"article:published_time\" content=\"2025-11-18T19:28:06+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-11-18T19:28:08+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/officechai.com\/wp-content\/uploads\/2025\/11\/G6DPUcsWMAQ92cq.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1956\" \/>\n\t<meta property=\"og:image:height\" content=\"1154\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"OfficeChai Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@OfficeChai\" \/>\n<meta name=\"twitter:site\" content=\"@OfficeChai\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"OfficeChai Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/\",\"url\":\"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/\",\"name\":\"Google's Gemini 3 Model Makes 2X Jump Over Previous State-of-the-art on ARC-AGI Prize\",\"isPartOf\":{\"@id\":\"https:\/\/officechai.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/11\/G6DPUcsWMAQ92cq.jpg?fit=1956%2C1154&ssl=1\",\"datePublished\":\"2025-11-18T19:28:06+00:00\",\"dateModified\":\"2025-11-18T19:28:08+00:00\",\"author\":{\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2\"},\"breadcrumb\":{\"@id\":\"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/11\/G6DPUcsWMAQ92cq.jpg?fit=1956%2C1154&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/11\/G6DPUcsWMAQ92cq.jpg?fit=1956%2C1154&ssl=1\",\"width\":1956,\"height\":1154,\"caption\":\"arc agi gemini 3\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/officechai.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Google’s Gemini 3 Model Makes 2X Jump Over Previous State-of-the-art on ARC-AGI Prize\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/officechai.com\/#website\",\"url\":\"https:\/\/officechai.com\/\",\"name\":\"OfficeChai\",\"description\":\"Startups, Businesses And Careers\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/officechai.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2\",\"name\":\"OfficeChai Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g\",\"caption\":\"OfficeChai Team\"},\"description\":\"Dotting the i's, crossing the t's.\",\"url\":\"https:\/\/officechai.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Google's Gemini 3 Model Makes 2X Jump Over Previous State-of-the-art on ARC-AGI Prize","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/","og_locale":"en_US","og_type":"article","og_title":"Google's Gemini 3 Model Makes 2X Jump Over Previous State-of-the-art on ARC-AGI Prize","og_description":"Google’s Gemini 3 Model has topped most benchmarks, but it’s done particularly well on one that tracks how close models are to AGI....","og_url":"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/","og_site_name":"OfficeChai","article_publisher":"https:\/\/www.facebook.com\/OfficeChai\/","article_published_time":"2025-11-18T19:28:06+00:00","article_modified_time":"2025-11-18T19:28:08+00:00","og_image":[{"width":1956,"height":1154,"url":"http:\/\/officechai.com\/wp-content\/uploads\/2025\/11\/G6DPUcsWMAQ92cq.jpg","type":"image\/jpeg"}],"author":"OfficeChai Team","twitter_card":"summary_large_image","twitter_creator":"@OfficeChai","twitter_site":"@OfficeChai","twitter_misc":{"Written by":"OfficeChai Team","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/","url":"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/","name":"Google's Gemini 3 Model Makes 2X Jump Over Previous State-of-the-art on ARC-AGI Prize","isPartOf":{"@id":"https:\/\/officechai.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/#primaryimage"},"image":{"@id":"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/11\/G6DPUcsWMAQ92cq.jpg?fit=1956%2C1154&ssl=1","datePublished":"2025-11-18T19:28:06+00:00","dateModified":"2025-11-18T19:28:08+00:00","author":{"@id":"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2"},"breadcrumb":{"@id":"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/#primaryimage","url":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/11\/G6DPUcsWMAQ92cq.jpg?fit=1956%2C1154&ssl=1","contentUrl":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/11\/G6DPUcsWMAQ92cq.jpg?fit=1956%2C1154&ssl=1","width":1956,"height":1154,"caption":"arc agi gemini 3"},{"@type":"BreadcrumbList","@id":"https:\/\/officechai.com\/ai\/googles-gemini-3-model-makes-2x-jump-over-previous-state-of-the-art-on-arc-agi-prize\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/officechai.com\/"},{"@type":"ListItem","position":2,"name":"Google’s Gemini 3 Model Makes 2X Jump Over Previous State-of-the-art on ARC-AGI Prize"}]},{"@type":"WebSite","@id":"https:\/\/officechai.com\/#website","url":"https:\/\/officechai.com\/","name":"OfficeChai","description":"Startups, Businesses And Careers","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/officechai.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2","name":"OfficeChai Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/officechai.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g","caption":"OfficeChai Team"},"description":"Dotting the i's, crossing the t's.","url":"https:\/\/officechai.com\/author\/admin\/"}]}},"jetpack_featured_media_url":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/11\/G6DPUcsWMAQ92cq.jpg?fit=1956%2C1154&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/p685C6-eUU","jetpack_likes_enabled":true,"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/57344","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/comments?post=57344"}],"version-history":[{"count":1,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/57344\/revisions"}],"predecessor-version":[{"id":57347,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/57344\/revisions\/57347"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/media\/57345"}],"wp:attachment":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/media?parent=57344"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/categories?post=57344"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/tags?post=57344"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}