Microsoft has updated Copilot Vision, allowing it to view the entire desktop or specific app windows, a shift from its previous limitation of analyzing two apps at once. This feature activates via a glasses icon in the Copilot app, offering functions similar to screen sharing. Copilot Vision can help by analyzing content, providing insights, and coaching users aloud. It also supports answering questions about what it observes through a mobile phone's camera, enhancing usability beyond just browsing in Edge.
Copilot Vision allows the AI tool to see everything on your screen, transforming it from viewing two apps at a time to your entire desktop or specific app windows.
Activating Copilot Vision is similar to screen sharing; it enables analysis of content and provides insights as you work on creative projects or games.
Microsoft initially tested Copilot Vision in Edge, enabling it to answer questions about what is visible through the user's mobile phone camera.
Unlike Recall, which takes regular snapshots, Copilot Vision requires user activation to share the screen content dynamically.
Collection
[
|
...
]