Copilot Vision

Copilot Vision Arrives on Windows to Guide App Usage

Microsoft is extending the capabilities of its Copilot Vision feature beyond web browsers, bringing it to both Windows and mobile platforms. Previously confined to Edge webpages, Copilot Vision can now analyze real-time video from a mobile camera, offering assistance with tasks like plant care and home decor.

The feature is launching within the Copilot app for iOS and Android, with a similar functionality soon to arrive on Windows. The updated Copilot app for Windows will support Copilot Vision across your entire PC, enabling the AI assistant to provide guidance on using applications like Adobe Photoshop or analyzing photos and webpages.

Unlike Microsoft's Recall feature on Copilot Plus PCs, which automatically takes snapshots, Copilot Vision functions more like screen sharing, allowing you to share an app or your entire desktop. Copilot Vision on Windows will initially be available to Windows Insiders next week, with a wider rollout planned after testing.

Microsoft is also introducing a range of new features to Copilot, including memory, personalization, web-based actions, podcast creation, and deep research capabilities.

Source: The Verge