Microsoft's Copilot Vision Now Analyzes Running Apps on Windows

Microsoft unveils Copilot Vision for Windows today, enhancing its AI assistant with screen-sharing capabilities. This new feature enables real-time guidance for tasks like mastering Adobe Photoshop tools or analyzing images and webpages you're viewing.
"Once activated, Copilot Vision observes your screen activity and engages in live discussions about what you see," explains the Copilot team. "It serves as your digital assistant, offering instant analysis, troubleshooting support, contextual insights, and answering queries throughout your workflow."
Following initial Windows testing earlier this year, Copilot Vision now launches as a free feature for US-based Windows 10 and 11 users. While no longer requiring Copilot Pro, it remains part of Microsoft's Copilot Labs experimental AI program.
The Windows version operates within the Copilot app, accessible via a glasses icon for selecting specific browser windows or applications to share - similar to screen-sharing in Microsoft Teams. Unlike Recall's continuous recording, Copilot Vision requires explicit user permission for each session.
Due to US-only availability restrictions, comprehensive testing wasn't possible, though preliminary experience was gained during Microsoft's anniversary event last April. When sharing applications, Copilot Vision provides on-screen visual cues and responsive assistance. The functionality extends to iOS and Android platforms as well.
Update, June 12th: Clarified that Copilot Pro subscription isn't mandatory for Copilot Vision.
Related article
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
Related Special Topic Recommendations
Comments (0)
0/500

Microsoft unveils Copilot Vision for Windows today, enhancing its AI assistant with screen-sharing capabilities. This new feature enables real-time guidance for tasks like mastering Adobe Photoshop tools or analyzing images and webpages you're viewing.
"Once activated, Copilot Vision observes your screen activity and engages in live discussions about what you see," explains the Copilot team. "It serves as your digital assistant, offering instant analysis, troubleshooting support, contextual insights, and answering queries throughout your workflow."
Following initial Windows testing earlier this year, Copilot Vision now launches as a free feature for US-based Windows 10 and 11 users. While no longer requiring Copilot Pro, it remains part of Microsoft's Copilot Labs experimental AI program.
The Windows version operates within the Copilot app, accessible via a glasses icon for selecting specific browser windows or applications to share - similar to screen-sharing in Microsoft Teams. Unlike Recall's continuous recording, Copilot Vision requires explicit user permission for each session.
Due to US-only availability restrictions, comprehensive testing wasn't possible, though preliminary experience was gained during Microsoft's anniversary event last April. When sharing applications, Copilot Vision provides on-screen visual cues and responsive assistance. The functionality extends to iOS and Android platforms as well.
Update, June 12th: Clarified that Copilot Pro subscription isn't mandatory for Copilot Vision.
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ





Home






