Microsoft has introduced a suite of new AI-driven features for Windows 11. These include an agent that allows users to manage settings via text commands, as well as Copilot Vision, a tool capable of “seeing” what is displayed on the screen.
Agent
The new agent simplifies system configuration and task execution. To use it, users need to open settings through the taskbar or Start menu and enter a request in plain language, such as:
- I want to enable quiet mode;
- connect a Bluetooth device;
- change the resolution to 1920×1080.
If the agent can make the desired change, it will offer to perform the action.
Access to the digital assistant is available today for Windows users in English with Copilot+ PCs powered by Snapdragon. Support for Intel and AMD devices will follow later.
Copilot Vision
Copilot Vision enables real-time analysis of screen content and interaction with the user. It answers questions, provides guidance, and assists with navigating applications and documents.
Copilot can visually demonstrate how to perform a task directly within an application.
The assistant can navigate between multiple windows simultaneously, including the desktop.
Sticker Generator in Paint
Users can now create unique stickers using a text prompt. To do this, select the generator in the Copilot menu and enter a request.
Once created, the finished product can be added to the canvas or copied for use in other applications.
Additionally, Paint now includes the ability to select and edit individual image elements.
Relight
The Relight feature in the Photos app adds professional lighting tools to images.
Users can place up to three virtual light sources around the subject in a photo and adjust each for:
- brightness;
- color;
- position;
- light softness.
Also added are:
- Click to Do — helps complete tasks faster by offering contextual actions for text and images on the screen without needing to switch between windows;
- Perfect Screenshot — allows precise capture of desired content for a screenshot;
- Color Picker — enables users to identify and copy colors from any part of the screen.
Previously, Microsoft saved $500 million thanks to AI and laid off 15,000 employees.
Earlier, the company integrated an AI generator based on OpenAI’s Sora model into the Bing mobile app.
