{"id":17449,"date":"2024-10-02T11:34:05","date_gmt":"2024-10-02T08:34:05","guid":{"rendered":"https:\/\/forklog.com\/en\/microsoft-enhances-copilot-with-voice-and-vision-capabilities\/"},"modified":"2024-10-02T11:34:05","modified_gmt":"2024-10-02T08:34:05","slug":"microsoft-enhances-copilot-with-voice-and-vision-capabilities","status":"publish","type":"post","link":"https:\/\/forklog.com\/en\/microsoft-enhances-copilot-with-voice-and-vision-capabilities\/","title":{"rendered":"Microsoft Enhances Copilot with Voice and Vision Capabilities"},"content":{"rendered":"<p>Microsoft <a href=\"https:\/\/blogs.microsoft.com\/blog\/2024\/10\/01\/an-ai-companion-for-everyone\/\">has unveiled<\/a> an updated version of its AI assistant, Copilot, now featuring voice mode and screen image comprehension.\u00a0<\/p>\n<p>The Copilot Voice functionality allows users to converse with the neural network, posing questions and brainstorming on the go. Four voice options are available.<\/p>\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\">\n<div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Copilot Voice\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/z0MqgFjoQKg?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div>\n<\/figure>\n<p>Copilot Vision offers a &#8220;fundamentally new way of interacting with a computer.&#8221; The AI can analyze on-screen content and discuss it in real-time. It understands text and images from a viewed web page and can answer questions about its content.\u00a0<\/p>\n<p>For the Vision service, Microsoft assures &#8220;safety and security&#8221;\u2014data is neither stored nor used for training purposes.<\/p>\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\">\n<div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Copilot Vision\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/vSOp4uhgSjw?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div>\n<\/figure>\n<p>Other Copilot features include:<\/p>\n<ul class=\"wp-block-list\">\n<li>Copilot Daily \u2014 the AI provides news summaries, weather updates, and event reminders;<\/li>\n<li>integration of Copilot into Microsoft Edge \u2014 the assistant is embedded in the browser, capable of summarizing page content, translating text, and rewriting sentences;<\/li>\n<li>Copilot Labs \u2014 offers the opportunity to test experimental neural network features;<\/li>\n<li>Think Deeper \u2014 Copilot can ponder complex questions, taking more time;<\/li>\n<li>Copilot Discover will offer guidance on useful AI features and gradually personalize the experience based on user interaction with other Microsoft services.<\/li>\n<\/ul>\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\">\n<div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Copilot - Personalized Discover Cards\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/yzFbAhJ8hhg?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div>\n<\/figure>\n<p>The updated Copilot is available on iOS, Android, Windows, WhatsApp, and the web interface.<\/p>\n<p>Microsoft also <a href=\"https:\/\/blogs.bing.com\/search\/October-2024\/The-next-step-in-Bing-generative-search\">announced<\/a> the launch of generative search in Bing, starting in the United States. The tool gathers information from across the internet to create a summary in response to a search query.\u00a0<\/p>\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1439\" height=\"921\" src=\"https:\/\/forklog.com\/wp-content\/uploads\/Elephant-1.gif\" alt=\"Elephant-1\" class=\"wp-image-242353\"\/><figcaption class=\"wp-element-caption\">Generative search in Bing. Source: Bing blog.<\/figcaption><\/figure>\n<p>Meanwhile, Microsoft has ceased production of HoloLens 2, as reported by <a href=\"https:\/\/www.uploadvr.com\/microsoft-discontinuing-hololens-2\/\">UploadVR<\/a>. The mixed reality headset will continue to receive updates until December 31, 2027. The company will focus on its partnership with Meta in AR and VR technologies.\u00a0<\/p>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-rt.googleusercontent.com\/docsz\/AD_4nXdiSN1jw1x702XdHPmnQudX0UvwoUDCUDhgkpbIqA-97JJA3_ZTTiy1kjUZ9nkmuHLQcBZjuDq8iXi2dauXcJGaVMkP8egfPvNaRborKbpfJyfkZubMzuLTG_wD6E7fJyWodDQRwqHrdz-C27EA5BKu0WbG?key=02OfNpkLMhalW7FEN3uiLw\" alt=\"Microsoft \u043d\u0430\u0443\u0447\u0438\u043b\u0430 Copilot \u00ab\u0433\u043e\u0432\u043e\u0440\u0438\u0442\u044c \u0438 \u0432\u0438\u0434\u0435\u0442\u044c\u00bb\"\/><figcaption class=\"wp-element-caption\">HoloLens 2 mixed reality headset. Source: UploadVR.<\/figcaption><\/figure>\n<p>Back in September 2023, the tech giant announced the Copilot system, which integrates Windows OS interfaces with AI language models.<\/p>\n<p>In July 2024, the company <a href=\"https:\/\/forklog.com\/en\/news\/microsoft-launches-ai-powered-designer-app-for-ios-and-android\">introduced<\/a> the Designer app on iOS and Android\u2014a graphic designer for generating and editing images using AI.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Microsoft has unveiled an updated version of its AI assistant, Copilot, now featuring voice mode and screen image comprehension.\u00a0 The Copilot Voice functionality allows users to converse with the neural network, posing questions and brainstorming on the go. Four voice options are available. Copilot Vision offers a &#8220;fundamentally new way of interacting with a computer.&#8221; [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":17448,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"select":"","news_style_id":"","cryptorium_level":"","_short_excerpt_text":"","creation_source":"","_metatest_mainpost_news_update":false,"footnotes":""},"categories":[3],"tags":[438,15],"class_list":["post-17449","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news-and-analysis","tag-artificial-intelligence","tag-microsoft"],"aioseo_notices":[],"amp_enabled":true,"views":"39","promo_type":"","layout_type":"","short_excerpt":"","is_update":"","_links":{"self":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/posts\/17449","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/comments?post=17449"}],"version-history":[{"count":0,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/posts\/17449\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/media\/17448"}],"wp:attachment":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/media?parent=17449"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/categories?post=17449"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/tags?post=17449"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}