Microsoft is taking the AI-supported user experience one step further with the new feature it added to the Copilot application in Windows 10 and 11 operating systems. This feature, called “Copilot Vision,” analyzes the content displayed on the computer screen and provides the user with real-time information, guidance, and context.

Copilot Vision feature is now available

Copilot Vision provides direct assistance to the user, especially in learning and using Windows applications effectively. By sharing any application with Copilot, the user can instantly ask how to perform a certain operation in that application.

For example, in tasks such as trimming a video, removing an unwanted object from a photo, or finding a setting, Copilot understands the content on the screen and guides step by step. This feature aims to replace traditional “How to” guides with a one-to-one, in-app help experience.

Copilot Vision can work with two applications at the same time. This way, users can continue a process they started in one application with the help of Copilot in another application. The application’s “Highlights” feature offers the user additional explanations and visual guidance regarding the task they are currently doing.

To use Copilot Vision, the Copilot application is launched and the feature is activated by clicking on the glasses icon in the lower right corner. Then, the user selects the application they need help with and presses the “Share” button. After the help process, the sharing can be ended with the “Stop” command. The feature works optionally and does not become active without the user’s permission.

No clear date has been given for when the feature will be rolled out globally. So what do you think about this? You can share your opinions with us in the comments section below.