{"id":51494,"date":"2025-03-19T21:36:54","date_gmt":"2025-03-19T16:06:54","guid":{"rendered":"http:\/\/officechai.com\/?p=51494"},"modified":"2025-03-20T18:12:33","modified_gmt":"2025-03-20T12:42:33","slug":"am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun","status":"publish","type":"post","link":"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/","title":{"rendered":"Am No Longer Interested In LLMs, They Are Just Token Generators: Meta’s AI Chief Yann LeCun"},"content":{"rendered":"\n

Large Language Models or LLMs have taken the world by storm, and are finding applications in fields ranging from programming <\/a>to finance, but Meta’s AI Chief Yann LeCun feels they might’ve already reached the peak of their potential.<\/p>\n\n\n\n

Meta AI Chief Yann LeCun has said that he’s no longer interested in LLMs, and is looking to next-generation AI architectures that’ll be able to better model the real world. He says that these new AI architectures should enable AI to think more like humans, with persistent memory and the ability to think through complex problems.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

\u201cI am not interested anymore in LLMs,” LeCun said <\/a>at the NVIDIA GTC 2025 event. “They are just token generators and those are limited because tokens are in discrete space. I am more interested in next-gen model architectures, that should be able to do 4 things: understand physical world, have persistent memory and ultimately be more capable to plan and reason,\u201d he added.<\/p>\n\n\n\n

This isn’t the first time that LeCun has expressed the limitations of LLMs. LLMs largely learn through text data, and he’s said that text data alone is insufficient for achieving human-level AI. \u201cA typical large language model is trained with something on the order of 20 trillion tokens or words,” he’d recently said<\/a>. “That\u2019s about 10 to the power 14 bytes; one with 14 zeros behind it. It’s an enormous amount of information,” he’d said.<\/p>\n\n\n\n

\u201cBut then you compare this with the amount of information that gets to our brains through the visual system in the first four years of life, and it\u2019s about the same amount,” he continues. “In four years, a young child has been awake a total of about 16,000 hours. The amount of information getting to the brain through the optic nerve is about 2 megabytes per second. Do the calculation and that\u2019s about 10 to the power 14 bytes. It\u2019s about the same. In four years a young child has seen as much information or data as the biggest LLMs,\u201d he’d said.<\/p>\n\n\n\n

\u201c(This means that) we\u2019re never going to get to human-level AI by just training on text. We\u2019re going to have to get systems to understand the real world,” he’d said.<\/p>\n\n\n\n

LeCun has now said that he’s not interested in LLMs any more. Indeed, Meta itself hasn’t released a new version of Llama in a while, and DeepSeek <\/a>and other companies have taken over the mantle of releasing the top open-source models. LeCun’s approach seems to be in contrast to OpenAI’s, which has consistently maintained <\/a>there’s no wall in scaling LLM capabilities, and has instead been coming up with add-ons to LLM training, like test-time compute, to increase their capabilities. It remains to be seen which approach works out, but it appears that Meta is bearish on LLMs, and seems to believe that it’ll take a new technological breakthrough to dramatically improve the performance of current AI systems.<\/p>\n","protected":false},"excerpt":{"rendered":"

Large Language Models or LLMs have taken the world by storm, and are finding applications in fields ranging from programming to finance, but…<\/p>\n","protected":false},"author":1,"featured_media":51496,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1029],"tags":[],"class_list":["post-51494","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai"],"yoast_head":"\nAm No Longer Interested In LLMs, They Are Just Token Generators: Meta's AI Chief Yann LeCun<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Am No Longer Interested In LLMs, They Are Just Token Generators: Meta's AI Chief Yann LeCun\" \/>\n<meta property=\"og:description\" content=\"Large Language Models or LLMs have taken the world by storm, and are finding applications in fields ranging from programming to finance, but...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/\" \/>\n<meta property=\"og:site_name\" content=\"OfficeChai\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/OfficeChai\/\" \/>\n<meta property=\"article:published_time\" content=\"2025-03-19T16:06:54+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-03-20T12:42:33+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/03\/MixCollage-19-Mar-2025-09-17-PM-5339.jpg?fit=1200%2C630&ssl=1\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"OfficeChai Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@OfficeChai\" \/>\n<meta name=\"twitter:site\" content=\"@OfficeChai\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"OfficeChai Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/\",\"url\":\"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/\",\"name\":\"Am No Longer Interested In LLMs, They Are Just Token Generators: Meta's AI Chief Yann LeCun\",\"isPartOf\":{\"@id\":\"https:\/\/officechai.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/03\/MixCollage-19-Mar-2025-09-17-PM-5339.jpg?fit=1200%2C630&ssl=1\",\"datePublished\":\"2025-03-19T16:06:54+00:00\",\"dateModified\":\"2025-03-20T12:42:33+00:00\",\"author\":{\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2\"},\"breadcrumb\":{\"@id\":\"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/03\/MixCollage-19-Mar-2025-09-17-PM-5339.jpg?fit=1200%2C630&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/03\/MixCollage-19-Mar-2025-09-17-PM-5339.jpg?fit=1200%2C630&ssl=1\",\"width\":1200,\"height\":630},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/officechai.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Am No Longer Interested In LLMs, They Are Just Token Generators: Meta’s AI Chief Yann LeCun\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/officechai.com\/#website\",\"url\":\"https:\/\/officechai.com\/\",\"name\":\"OfficeChai\",\"description\":\"Startups, Businesses And Careers\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/officechai.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2\",\"name\":\"OfficeChai Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g\",\"caption\":\"OfficeChai Team\"},\"description\":\"Dotting the i's, crossing the t's.\",\"url\":\"https:\/\/officechai.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Am No Longer Interested In LLMs, They Are Just Token Generators: Meta's AI Chief Yann LeCun","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/","og_locale":"en_US","og_type":"article","og_title":"Am No Longer Interested In LLMs, They Are Just Token Generators: Meta's AI Chief Yann LeCun","og_description":"Large Language Models or LLMs have taken the world by storm, and are finding applications in fields ranging from programming to finance, but...","og_url":"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/","og_site_name":"OfficeChai","article_publisher":"https:\/\/www.facebook.com\/OfficeChai\/","article_published_time":"2025-03-19T16:06:54+00:00","article_modified_time":"2025-03-20T12:42:33+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/03\/MixCollage-19-Mar-2025-09-17-PM-5339.jpg?fit=1200%2C630&ssl=1","type":"image\/jpeg"}],"author":"OfficeChai Team","twitter_card":"summary_large_image","twitter_creator":"@OfficeChai","twitter_site":"@OfficeChai","twitter_misc":{"Written by":"OfficeChai Team","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/","url":"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/","name":"Am No Longer Interested In LLMs, They Are Just Token Generators: Meta's AI Chief Yann LeCun","isPartOf":{"@id":"https:\/\/officechai.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/#primaryimage"},"image":{"@id":"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/03\/MixCollage-19-Mar-2025-09-17-PM-5339.jpg?fit=1200%2C630&ssl=1","datePublished":"2025-03-19T16:06:54+00:00","dateModified":"2025-03-20T12:42:33+00:00","author":{"@id":"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2"},"breadcrumb":{"@id":"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/#primaryimage","url":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/03\/MixCollage-19-Mar-2025-09-17-PM-5339.jpg?fit=1200%2C630&ssl=1","contentUrl":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/03\/MixCollage-19-Mar-2025-09-17-PM-5339.jpg?fit=1200%2C630&ssl=1","width":1200,"height":630},{"@type":"BreadcrumbList","@id":"https:\/\/officechai.com\/ai\/am-no-longer-interested-in-llms-they-are-just-token-generators-metas-ai-chief-yann-lecun\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/officechai.com\/"},{"@type":"ListItem","position":2,"name":"Am No Longer Interested In LLMs, They Are Just Token Generators: Meta’s AI Chief Yann LeCun"}]},{"@type":"WebSite","@id":"https:\/\/officechai.com\/#website","url":"https:\/\/officechai.com\/","name":"OfficeChai","description":"Startups, Businesses And Careers","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/officechai.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2","name":"OfficeChai Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/officechai.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g","caption":"OfficeChai Team"},"description":"Dotting the i's, crossing the t's.","url":"https:\/\/officechai.com\/author\/admin\/"}]}},"jetpack_featured_media_url":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2025\/03\/MixCollage-19-Mar-2025-09-17-PM-5339.jpg?fit=1200%2C630&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/p685C6-doy","jetpack_likes_enabled":true,"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/51494","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/comments?post=51494"}],"version-history":[{"count":2,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/51494\/revisions"}],"predecessor-version":[{"id":51501,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/51494\/revisions\/51501"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/media\/51496"}],"wp:attachment":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/media?parent=51494"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/categories?post=51494"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/tags?post=51494"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}