{"id":22868,"date":"2025-04-09T14:53:52","date_gmt":"2025-04-09T11:53:52","guid":{"rendered":"https:\/\/forklog.com\/en\/microsoft-enhances-copilot-with-screen-analysis-and-app-assistance\/"},"modified":"2025-04-09T14:53:52","modified_gmt":"2025-04-09T11:53:52","slug":"microsoft-enhances-copilot-with-screen-analysis-and-app-assistance","status":"publish","type":"post","link":"https:\/\/forklog.com\/en\/microsoft-enhances-copilot-with-screen-analysis-and-app-assistance\/","title":{"rendered":"Microsoft Enhances Copilot with Screen Analysis and App Assistance"},"content":{"rendered":"<p>Microsoft has commenced testing an update for Copilot on Windows, enabling the AI to analyze screen images and provide guidance on various application functionalities, according to <a href=\"https:\/\/www.theverge.com\/news\/645666\/microsoft-copilot-vision-windows-beta-testing\">The Verge<\/a>.<\/p>\n<p>Copilot Vision will assist with basic functions in Adobe Photoshop or analyze photos and visited web pages. In one example, the AI assistant aided with Minecraft gameplay and optimized settings in the video editor Clipchamp.<\/p>\n<p>Copilot can highlight parts of the screen to guide users while working with applications.<\/p>\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>\u201cCopilot Vision might seem similar to Microsoft\u2019s <a href=\"https:\/\/forklog.com\/en\/news\/microsoft-halts-release-of-ai-feature-recall-amid-criticism\">Recall<\/a> feature, which automatically takes screenshots if permitted, but it is more akin to sharing an app screen or the entire desktop in Microsoft Teams,\u201d the publication emphasized.<\/p>\n<\/blockquote>\n<p>Microsoft has also begun testing a file search feature in Copilot on Windows, such as searching by document text.<\/p>\n<p>Both features require only the Copilot app on Windows, not a full Copilot Plus computer. The test began in the Windows Insiders program, with deployment to Windows 11 users expected in the coming weeks or months.<\/p>\n<p>In October 2024, Microsoft <a href=\"https:\/\/forklog.com\/en\/news\/microsoft-enhances-copilot-with-voice-and-vision-capabilities\">introduced<\/a> an updated version of the Copilot AI assistant with voice mode and screen image understanding.<\/p>\n<p>Later, the company <a href=\"https:\/\/forklog.com\/en\/news\/microsoft-introduces-two-ai-agents-for-in-depth-research\">announced<\/a> the addition of two \u201creasoning\u201d AI agents to Microsoft 365 Copilot for analyzing large volumes of information and providing expert insights.<\/p>\n<p>Back in March, Xbox <a href=\"https:\/\/forklog.com\/en\/news\/xbox-unveils-ai-gaming-assistant\">unveiled<\/a> Copilot for Gaming\u2014an AI-driven assistant designed to be a \u201cpersonal gaming companion.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Microsoft has commenced testing an update for Copilot on Windows, enabling the AI to analyze screen images and provide guidance on various application functionalities, according to The Verge. Copilot Vision will assist with basic functions in Adobe Photoshop or analyze photos and visited web pages. In one example, the AI assistant aided with Minecraft gameplay [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":22867,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"select":"","news_style_id":"","cryptorium_level":"","_short_excerpt_text":"","creation_source":"","_metatest_mainpost_news_update":false,"footnotes":""},"categories":[3],"tags":[438,15],"class_list":["post-22868","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news-and-analysis","tag-artificial-intelligence","tag-microsoft"],"aioseo_notices":[],"amp_enabled":true,"views":"75","promo_type":"","layout_type":"","short_excerpt":"","is_update":"","_links":{"self":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/posts\/22868","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/comments?post=22868"}],"version-history":[{"count":0,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/posts\/22868\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/media\/22867"}],"wp:attachment":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/media?parent=22868"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/categories?post=22868"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/tags?post=22868"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}