Microsoft Enhances Copilot with Voice and Vision Capabilities

Microsoft has unveiled an updated version of its AI assistant, Copilot, now featuring voice mode and screen image comprehension. 

The Copilot Voice functionality allows users to converse with the neural network, posing questions and brainstorming on the go. Four voice options are available.

Copilot Vision offers a “fundamentally new way of interacting with a computer.” The AI can analyze on-screen content and discuss it in real-time. It understands text and images from a viewed web page and can answer questions about its content. 

For the Vision service, Microsoft assures “safety and security”—data is neither stored nor used for training purposes.

Other Copilot features include:

• Copilot Daily — the AI provides news summaries, weather updates, and event reminders;
• integration of Copilot into Microsoft Edge — the assistant is embedded in the browser, capable of summarizing page content, translating text, and rewriting sentences;
• Copilot Labs — offers the opportunity to test experimental neural network features;
• Think Deeper — Copilot can ponder complex questions, taking more time;
• Copilot Discover will offer guidance on useful AI features and gradually personalize the experience based on user interaction with other Microsoft services.

The updated Copilot is available on iOS, Android, Windows, WhatsApp, and the web interface.

Microsoft also announced the launch of generative search in Bing, starting in the United States. The tool gathers information from across the internet to create a summary in response to a search query. 

Meanwhile, Microsoft has ceased production of HoloLens 2, as reported by UploadVR. The mixed reality headset will continue to receive updates until December 31, 2027. The company will focus on its partnership with Meta in AR and VR technologies. 

Back in September 2023, the tech giant announced the Copilot system, which integrates Windows OS interfaces with AI language models.

In July 2024, the company introduced the Designer app on iOS and Android—a graphic designer for generating and editing images using AI.