{"id":199821,"date":"2024-11-15T09:48:36","date_gmt":"2024-11-15T09:48:36","guid":{"rendered":"https:\/\/ibkrcampus.eu\/campus\/?p=199821"},"modified":"2024-11-15T16:26:30","modified_gmt":"2024-11-15T16:26:30","slug":"will-large-language-models-change-robotics","status":"publish","type":"post","link":"https:\/\/www.interactivebrokers.eu\/campus\/traders-insight\/will-large-language-models-change-robotics\/","title":{"rendered":"Will large language models change robotics?"},"content":{"rendered":"\n<p>Originally posted, 13 November 2024 &#8211; <a href=\"https:\/\/www.wisdomtree.eu\/fr-lu\/blog\/2024-11-13\/will-large-language-models-change-robotics\">Will large language models change robotics?<\/a><\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-key-takeaways\">Key Takeaways<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Covariant uses LLMs to give robots more flexibility in real-time decision-making.<\/li>\n\n\n\n<li>Traditional robot programming is limited, but Covariant\u2019s approach offers adaptability for complex tasks.<\/li>\n\n\n\n<li>Amazon hired Covariant\u2019s founders, signalling the potential for AI-driven robotics in global logistics.<\/li>\n\n\n\n<li>This technology could revolutionise how robots manage item sorting and logistics operations for companies like Amazon.<\/li>\n\n\n\n<li>The intersection of AI and robotics is set to transform industrial operations on a global scale.<\/li>\n<\/ul>\n\n\n\n<p>Hans Moravec, an adjunct faculty member at the Robotics Institute of Carnegie Mellon University, wrote in 1988, \u201cIt is comparatively easy to make computers exhibit adult-level performance on intelligence tests or playing checkers, and difficult or impossible to give them the skills of a one-year-old when it comes to perception and mobility\u201d.<\/p>\n\n\n\n<p id=\"robots\">&nbsp;<\/p>\n\n\n\n<p>Another way to think about this regards driving. In the US, it is typical for a high school-aged student around 16 years old to get a \u2018learner\u2019s permit\u2019 over the adjacent summer, usually between sophomore year and junior year. Over that summer, the student, alongside a licensed driver, gains a certain number of hours and miles of driving experience. In most cases, this is enough to then take the \u2018driving test\u2019 which is administered on a state-by-state basis.&nbsp;<\/p>\n\n\n\n<p>On the other hand, there are autonomous driving systems that have been trained, in many cases in simulation, on the equivalent of billions of miles driven. These systems \u2013 again, with billions of miles under their virtual belts \u2013 are not trusted enough to be widely deployed across the world.&nbsp;<\/p>\n\n\n\n<p>There are many cases like this where it becomes clearer and clearer that the way that humans and computer systems learn is totally different.&nbsp;<\/p>\n\n\n\n<p id=\"limited\">&nbsp;<\/p>\n\n\n\n<p><strong>The case of Covariant<\/strong><\/p>\n\n\n\n<p>Covariant Robotics has a great website where it\u2019s possible to watch different videos of robotic systems undertaking different tasks. We have loved pointing this out to investors because it is a simple way to show what we believe is a very important, central point:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The \u2018old way\u2019 of running a robotic system is that one programs the system on precisely what to do. The positive of this is that the system is completely deterministic \u2013 you never see the robot doing something unexpected. The problem with this is that if the task cannot be explicitly programmed, the robot will not be able to do it.\u00a0<\/li>\n\n\n\n<li>The \u2018new way\u2019 of running a robotic system is that one points a large language model (LLM) at a task and gives the system an overall goal. One example could be sorting different items in a container. Instead of programming every possible scenario and seeking to account for every possible combination of things in a container, the system could optimise sorting items from a container based on a set of foundational principles. The benefit of this is, of course, flexibility, but the risk is that it could be difficult to understand what the robot will do \u2013 thereby creating a possibly dangerous set of circumstances if, for instance, people are positioned near the robot.\u00a0<\/li>\n<\/ul>\n\n\n\n<p>In our opinion, this is the power of what Covariant\u2019s videos show on its website. The system pairs the robot\u2019s control system with a natural language interface, so as the system attempts different things to complete a task, text appears on a screen, lending explainability to what the robot is about to try.&nbsp;<\/p>\n\n\n\n<p>The video with the gripping system based largely on suction attempting to pick up and sort pairs of socks was particularly powerful. If one can picture how socks tend to be packed, there is usually a smooth, sticky paper-like surface at the centre with the cloth socks extending above and below.&nbsp;<\/p>\n\n\n\n<p>As people living in the world, we know what is likely to happen if the suction system attempts to pick up the socks connecting to the cloth \u2013 it wouldn\u2019t be possible to get a good seal for the suction to do its job against the fabric. The system would be better served if it focused on the package&#8217;s smooth paper, often the label.&nbsp;<\/p>\n\n\n\n<p>Covariant\u2019s system allows you to see the text of the robotic system working this out in real-time.&nbsp;<\/p>\n\n\n\n<p id=\"amazon\">&nbsp;<\/p>\n\n\n\n<p><strong>Amazon hires the founders of Covariant<sup>1<\/sup><\/strong><\/p>\n\n\n\n<p>Amazon is one of the most amazing studies of logistics management we have ever seen in global commerce. It can deliver many different items within a day or less to almost any location worldwide. It is a staggering operation.&nbsp;<\/p>\n\n\n\n<p id=\"companies\">&nbsp;<\/p>\n\n\n\n<p>Intuitively, robots would be additive to this effort because they can run tirelessly, 24-7-365. However, a core part of what is needed is the capability to pick up and sort almost any type of item appropriately. Remember what Hans Moravec noted \u2013 developing and programming a system that can properly handle any object is vastly more challenging than it may seem.&nbsp;<\/p>\n\n\n\n<p id=\"scale\">&nbsp;<\/p>\n\n\n\n<p>When we saw an article in WIRED noting that Amazon was hiring the founders of Covariant and licensing its technology, we could not have been more excited. It was always cool to visit Covariant\u2019s website, but if, in the coming years, we can start telling the story of how the robotics technology that connects to LLMs is powering Amazon\u2019s logistics operation \u2013 this story becomes basically self-explanatory in terms of the power of the intersection between robotics and AI. It is still relatively early, but the robotics story is something we are keeping a close eye on.&nbsp;<\/p>\n\n\n\n<p>Source<\/p>\n\n\n\n<p><sup>1<\/sup>&nbsp;Knight, Will. \u201cThis Could Be the Start of Amazon\u2019s Next Robot Revolution.\u201d WIRED. 4 September 2024.&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Will large language models change robotics?<\/p>\n","protected":false},"author":1242,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":true,"footnotes":""},"categories":[146,12,148,7],"tags":[],"contributors-categories":[529],"class_list":{"0":"post-199821","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-macro","7":"category-securities","8":"category-text-articles","9":"category-traders-insight","10":"contributors-categories-wisdomtree-europe"},"pp_statuses_selecting_workflow":false,"pp_workflow_action":"current","pp_status_selection":"publish","acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v26.9 (Yoast SEO v27.7) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Will large language models change robotics?<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.interactivebrokers.eu\/campus\/wp-json\/wp\/v2\/posts\/199821\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Will large language models change robotics?\" \/>\n<meta property=\"og:description\" content=\"Will large language models change robotics?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.interactivebrokers.eu\/campus\/traders-insight\/will-large-language-models-change-robotics\/\" \/>\n<meta property=\"og:site_name\" content=\"IBKR Campus EU\" \/>\n<meta property=\"article:published_time\" content=\"2024-11-15T09:48:36+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-11-15T16:26:30+00:00\" \/>\n<meta name=\"author\" content=\"Julian Amorim\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Julian Amorim\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\n\t    \"@context\": \"https:\\\/\\\/schema.org\",\n\t    \"@graph\": [\n\t        {\n\t            \"@type\": \"Article\",\n\t            \"@id\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/traders-insight\\\/will-large-language-models-change-robotics\\\/#article\",\n\t            \"isPartOf\": {\n\t                \"@id\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/traders-insight\\\/will-large-language-models-change-robotics\\\/\"\n\t            },\n\t            \"author\": {\n\t                \"name\": \"Julian Amorim\",\n\t                \"@id\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/#\\\/schema\\\/person\\\/33613f54e9fc9f811b0e641082175d43\"\n\t            },\n\t            \"headline\": \"Will large language models change robotics?\",\n\t            \"datePublished\": \"2024-11-15T09:48:36+00:00\",\n\t            \"dateModified\": \"2024-11-15T16:26:30+00:00\",\n\t            \"mainEntityOfPage\": {\n\t                \"@id\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/traders-insight\\\/will-large-language-models-change-robotics\\\/\"\n\t            },\n\t            \"wordCount\": 938,\n\t            \"commentCount\": 0,\n\t            \"articleSection\": [\n\t                \"Macro\",\n\t                \"Securities\",\n\t                \"Text Articles\",\n\t                \"Traders' Insight\"\n\t            ],\n\t            \"inLanguage\": \"en-US\",\n\t            \"potentialAction\": [\n\t                {\n\t                    \"@type\": \"CommentAction\",\n\t                    \"name\": \"Comment\",\n\t                    \"target\": [\n\t                        \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/traders-insight\\\/will-large-language-models-change-robotics\\\/#respond\"\n\t                    ]\n\t                }\n\t            ]\n\t        },\n\t        {\n\t            \"@type\": \"WebPage\",\n\t            \"@id\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/traders-insight\\\/will-large-language-models-change-robotics\\\/\",\n\t            \"url\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/traders-insight\\\/will-large-language-models-change-robotics\\\/\",\n\t            \"name\": \"Will large language models change robotics? - IBKR Campus EU\",\n\t            \"isPartOf\": {\n\t                \"@id\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/#website\"\n\t            },\n\t            \"datePublished\": \"2024-11-15T09:48:36+00:00\",\n\t            \"dateModified\": \"2024-11-15T16:26:30+00:00\",\n\t            \"author\": {\n\t                \"@id\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/#\\\/schema\\\/person\\\/33613f54e9fc9f811b0e641082175d43\"\n\t            },\n\t            \"breadcrumb\": {\n\t                \"@id\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/traders-insight\\\/will-large-language-models-change-robotics\\\/#breadcrumb\"\n\t            },\n\t            \"inLanguage\": \"en-US\",\n\t            \"potentialAction\": [\n\t                {\n\t                    \"@type\": \"ReadAction\",\n\t                    \"target\": [\n\t                        \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/traders-insight\\\/will-large-language-models-change-robotics\\\/\"\n\t                    ]\n\t                }\n\t            ]\n\t        },\n\t        {\n\t            \"@type\": \"BreadcrumbList\",\n\t            \"@id\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/traders-insight\\\/will-large-language-models-change-robotics\\\/#breadcrumb\",\n\t            \"itemListElement\": [\n\t                {\n\t                    \"@type\": \"ListItem\",\n\t                    \"position\": 1,\n\t                    \"name\": \"Home\",\n\t                    \"item\": \"https:\\\/\\\/www.interactivebrokers.eu\\\/campus\\\/\"\n\t                },\n\t                {\n\t                    \"@type\": \"ListItem\",\n\t                    \"position\": 2,\n\t                    \"name\": \"Will large language models change robotics?\"\n\t                }\n\t            ]\n\t        },\n\t        {\n\t            \"@type\": \"WebSite\",\n\t            \"@id\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/#website\",\n\t            \"url\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/\",\n\t            \"name\": \"IBKR Campus EU\",\n\t            \"description\": \"\",\n\t            \"potentialAction\": [\n\t                {\n\t                    \"@type\": \"SearchAction\",\n\t                    \"target\": {\n\t                        \"@type\": \"EntryPoint\",\n\t                        \"urlTemplate\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/?s={search_term_string}\"\n\t                    },\n\t                    \"query-input\": {\n\t                        \"@type\": \"PropertyValueSpecification\",\n\t                        \"valueRequired\": true,\n\t                        \"valueName\": \"search_term_string\"\n\t                    }\n\t                }\n\t            ],\n\t            \"inLanguage\": \"en-US\"\n\t        },\n\t        {\n\t            \"@type\": \"Person\",\n\t            \"@id\": \"https:\\\/\\\/ibkrcampus.eu\\\/campus\\\/#\\\/schema\\\/person\\\/33613f54e9fc9f811b0e641082175d43\",\n\t            \"name\": \"Julian Amorim\",\n\t            \"url\": \"https:\\\/\\\/www.interactivebrokers.eu\\\/campus\\\/author\\\/julian1amorim\\\/\"\n\t        }\n\t    ]\n\t}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Will large language models change robotics?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.interactivebrokers.eu\/campus\/wp-json\/wp\/v2\/posts\/199821\/","og_locale":"en_US","og_type":"article","og_title":"Will large language models change robotics?","og_description":"Will large language models change robotics?","og_url":"https:\/\/www.interactivebrokers.eu\/campus\/traders-insight\/will-large-language-models-change-robotics\/","og_site_name":"IBKR Campus EU","article_published_time":"2024-11-15T09:48:36+00:00","article_modified_time":"2024-11-15T16:26:30+00:00","author":"Julian Amorim","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Julian Amorim","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ibkrcampus.eu\/campus\/traders-insight\/will-large-language-models-change-robotics\/#article","isPartOf":{"@id":"https:\/\/ibkrcampus.eu\/campus\/traders-insight\/will-large-language-models-change-robotics\/"},"author":{"name":"Julian Amorim","@id":"https:\/\/ibkrcampus.eu\/campus\/#\/schema\/person\/33613f54e9fc9f811b0e641082175d43"},"headline":"Will large language models change robotics?","datePublished":"2024-11-15T09:48:36+00:00","dateModified":"2024-11-15T16:26:30+00:00","mainEntityOfPage":{"@id":"https:\/\/ibkrcampus.eu\/campus\/traders-insight\/will-large-language-models-change-robotics\/"},"wordCount":938,"commentCount":0,"articleSection":["Macro","Securities","Text Articles","Traders' Insight"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/ibkrcampus.eu\/campus\/traders-insight\/will-large-language-models-change-robotics\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/ibkrcampus.eu\/campus\/traders-insight\/will-large-language-models-change-robotics\/","url":"https:\/\/ibkrcampus.eu\/campus\/traders-insight\/will-large-language-models-change-robotics\/","name":"Will large language models change robotics? - IBKR Campus EU","isPartOf":{"@id":"https:\/\/ibkrcampus.eu\/campus\/#website"},"datePublished":"2024-11-15T09:48:36+00:00","dateModified":"2024-11-15T16:26:30+00:00","author":{"@id":"https:\/\/ibkrcampus.eu\/campus\/#\/schema\/person\/33613f54e9fc9f811b0e641082175d43"},"breadcrumb":{"@id":"https:\/\/ibkrcampus.eu\/campus\/traders-insight\/will-large-language-models-change-robotics\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ibkrcampus.eu\/campus\/traders-insight\/will-large-language-models-change-robotics\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/ibkrcampus.eu\/campus\/traders-insight\/will-large-language-models-change-robotics\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.interactivebrokers.eu\/campus\/"},{"@type":"ListItem","position":2,"name":"Will large language models change robotics?"}]},{"@type":"WebSite","@id":"https:\/\/ibkrcampus.eu\/campus\/#website","url":"https:\/\/ibkrcampus.eu\/campus\/","name":"IBKR Campus EU","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ibkrcampus.eu\/campus\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/ibkrcampus.eu\/campus\/#\/schema\/person\/33613f54e9fc9f811b0e641082175d43","name":"Julian Amorim","url":"https:\/\/www.interactivebrokers.eu\/campus\/author\/julian1amorim\/"}]}},"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/ibkrcampus.eu\/campus\/wp-json\/wp\/v2\/posts\/199821","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ibkrcampus.eu\/campus\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ibkrcampus.eu\/campus\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ibkrcampus.eu\/campus\/wp-json\/wp\/v2\/users\/1242"}],"replies":[{"embeddable":true,"href":"https:\/\/ibkrcampus.eu\/campus\/wp-json\/wp\/v2\/comments?post=199821"}],"version-history":[{"count":0,"href":"https:\/\/ibkrcampus.eu\/campus\/wp-json\/wp\/v2\/posts\/199821\/revisions"}],"wp:attachment":[{"href":"https:\/\/ibkrcampus.eu\/campus\/wp-json\/wp\/v2\/media?parent=199821"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ibkrcampus.eu\/campus\/wp-json\/wp\/v2\/categories?post=199821"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ibkrcampus.eu\/campus\/wp-json\/wp\/v2\/tags?post=199821"},{"taxonomy":"contributors-categories","embeddable":true,"href":"https:\/\/ibkrcampus.eu\/campus\/wp-json\/wp\/v2\/contributors-categories?post=199821"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}