Microsoft Launches Copilot Vision on Windows: Letting AI 'See' Your Screen

Today, Microsoft officially rolled out a new feature called "Copilot Vision with Highlights" to the Copilot app for Windows 10 and 11, which allows artificial intelligence to analyze the content displayed on the screen and provide additional information, context, and real-time analysis. Microsoft describes this tool as a "second pair of eyes" for users.

 

Copilot Vision works in conjunction with other system apps, enabling seamless task transitions. The 'Highlights' feature lets you ask AI to guide you through actions within the app, for example:

1. Cut video in Clipchamp

2. Delete objects in the Photos app

Activation process

To activate this new feature, users just need to follow these steps:

1. Open Copilot application → click on the glass icon (right corner of the editing frame)

2. Select the application you want to share → click "Share"

3. Communicate with Copilot for suggestions, additional information

4. Stop sharing using the "Stop" button
   (Note: Copilot Pro subscription not required)

Microsoft emphasizes that this is a strictly opt -in feature, not an automatic one. The move represents a cautious approach following the 2024 Recall incident, especially with privacy-sensitive features.

Implementation roadmap

The feature is now rolling out to Windows users in the US, with countries outside Europe to follow. Microsoft has been testing Copilot Vision through the Windows Insiders program for several weeks ahead of its official launch in the coming weeks.