{"id":17998,"date":"2024-10-23T10:21:20","date_gmt":"2024-10-23T07:21:20","guid":{"rendered":"https:\/\/forklog.com\/en\/anthropics-ai-learns-to-navigate-computers-like-humans\/"},"modified":"2024-10-23T10:21:20","modified_gmt":"2024-10-23T07:21:20","slug":"anthropics-ai-learns-to-navigate-computers-like-humans","status":"publish","type":"post","link":"https:\/\/forklog.com\/en\/anthropics-ai-learns-to-navigate-computers-like-humans\/","title":{"rendered":"Anthropic&#8217;s AI Learns to Navigate Computers Like Humans"},"content":{"rendered":"<p>AI startup Anthropic has released an updated version of its Claude 3.5 Sonnet model, which can interact with computers like a human\u2014moving the cursor, clicking buttons, and typing text.<\/p>\n<blockquote class=\"twitter-tweet\">\n<p lang=\"en\" dir=\"ltr\">Introducing an upgraded Claude 3.5 Sonnet, and a new model, Claude 3.5 Haiku. We\u2019re also introducing a new capability in beta: computer use.<\/p>\n<p>Developers can now direct Claude to use computers the way people do\u2014by looking at a screen, moving a cursor, clicking, and typing text. <a href=\"https:\/\/t.co\/ZlywNPVIJP\">pic.twitter.com\/ZlywNPVIJP<\/a><\/p>\n<p>\u2014 Anthropic (@AnthropicAI) <a href=\"https:\/\/twitter.com\/AnthropicAI\/status\/1848742740420341988?ref_src=twsrc%5Etfw\">October 22, 2024<\/a><\/p><\/blockquote>\n<p> <script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>\u201cInstead of creating special tools to help Claude perform specific tasks, we are teaching it general computer skills, allowing it to use a wide range of standard solutions and programs developed for humans,\u201d noted Anthropic.<\/p>\n<\/blockquote>\n<p>Developers can leverage this capability to automate repetitive processes, create and test software, and perform other tasks. An <span data-descr=\"Application Programming Interface \u2014 a set of definitions and protocols that allows different software applications to interact with each other.\" class=\"old_tooltip\">API<\/span> has been created to enable Claude to perceive and interact with computer interfaces.<\/p>\n<p>The feature is experimental, so errors may occur. It is being tested by Asana, Canva, Cognition, DoorDash, Replit, and The Browser Company.<\/p>\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>\u201cSome actions that people perform effortlessly\u2014scrolling, dragging, zooming\u2014pose certain challenges for Claude,\u201d warned representatives of the AI startup.<\/p>\n<\/blockquote>\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\">\n<div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Claude | Computer use for automating operations\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/ODaHJzOyVCQ?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div>\n<\/figure>\n<p>Also introduced is the new AI model Claude 3.5 Haiku, set to be released at the end of October. It matches the performance of the company&#8217;s previous flagship neural network, Claude 3 Opus.<\/p>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-qw.googleusercontent.com\/docsz\/AD_4nXfPxk9GRScyn5lyIzF7iruaB1fvWWnsS6t3cus8ZcnmK4Ou87mc2sHfmoPDjaeRmJOSw1lW43Rw-D2ve00kNlRTQOwnwNP2kUs-ClWMQQTHavnC-c62N2__huV6XiBXKyV-xKrskrrvqRvkFzbudUxjm14?key=wQxk62P6NYyi0H5aGqeIfA\" alt=\"Anthropic \u043e\u0431\u0443\u0447\u0438\u043b \u0418\u0418 \u0432\u043e\u0434\u0438\u0442\u044c \u043a\u0443\u0440\u0441\u043e\u0440\u043e\u043c, \u043d\u0430\u0436\u0438\u043c\u0430\u0442\u044c \u043d\u0430 \u043a\u043d\u043e\u043f\u043a\u0438 \u0438 \u043f\u0435\u0447\u0430\u0442\u0430\u0442\u044c \u0442\u0435\u043a\u0441\u0442\"\/><figcaption class=\"wp-element-caption\">Comparison of Claude 3.5 Sonnet and Claude 3.5 Haiku across various benchmarks with other AIs. Data: <a href=\"https:\/\/www.anthropic.com\/news\/3-5-models-and-computer-use\">Anthropic<\/a>.<\/figcaption><\/figure>\n<p>The company reported improvements in Claude 3.5 Sonnet&#8217;s programming capabilities, citing customer feedback. GitLab noted the AI&#8217;s stronger reasoning, making it an \u201cideal choice\u201d for supporting multi-stage software development processes. Cognition and The Browser Company also gave positive reviews.<\/p>\n<p>Programming was also highlighted as a strength for the Claude 3.5 Haiku model. It scores 40.6% on SWE-bench Verified, surpassing many competitors.<\/p>\n<p>Earlier in October, OpenAI&#8217;s GPT-4o model achieved the highest score in programming with Solidity, outperforming o1-preview, o1-mini, and competitors.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>AI startup Anthropic has released an updated version of its Claude 3.5 Sonnet model, which can interact with computers like a human\u2014moving the cursor, clicking buttons, and typing text. Introducing an upgraded Claude 3.5 Sonnet, and a new model, Claude 3.5 Haiku. We\u2019re also introducing a new capability in beta: computer use. Developers can now [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":17997,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"select":"","news_style_id":"","cryptorium_level":"","_short_excerpt_text":"","creation_source":"","_metatest_mainpost_news_update":false,"footnotes":""},"categories":[3],"tags":[1434,438],"class_list":["post-17998","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news-and-analysis","tag-anthropic","tag-artificial-intelligence"],"aioseo_notices":[],"amp_enabled":true,"views":"109","promo_type":"","layout_type":"","short_excerpt":"","is_update":"","_links":{"self":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/posts\/17998","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/comments?post=17998"}],"version-history":[{"count":0,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/posts\/17998\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/media\/17997"}],"wp:attachment":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/media?parent=17998"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/categories?post=17998"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/tags?post=17998"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}