Microsoft's Copilot AI Now Analyzes Your Entire Screen Content
Microsoft is introducing an update to Copilot Vision for Windows Insiders, enabling the AI tool to analyze everything displayed on your screen. Previously limited to viewing two applications simultaneously and connecting information between them, the tool can now examine your entire desktop or any specific browser or application window, according to Microsoft.
Unlike Recall, which automatically captures periodic snapshots of your computer screen, using Copilot Vision resembles screen sharing during a video call. You can activate the feature by clicking the glasses icon within the Copilot app and selecting the desktop you want it to observe.
Image: MicrosoftAccording to Microsoft, Copilot Vision can "help analyze content, deliver insights, and answer your questions, guiding you through the process verbally." The company adds, "Get advice for refining your creative projects, assistance with enhancing your resume, or support while navigating unfamiliar games."
Microsoft initially launched testing for Copilot Vision last year as a feature capable of interpreting content viewed in the Edge browser. The tool can also respond to questions about visual input captured through your mobile phone's camera.
Related article
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
Related Special Topic Recommendations
Comments (3)
0/500
Wait, so Microsoft's Copilot can now watch everything on my screen? That's both impressive and mildly terrifying. 😅 I mean, sure, it could help with multitasking or finding info faster, but privacy-wise, this feels like a whole new level of surveillance. Hope they're transparent about what data gets stored or shared. Also, curious how well it handles messy desktop chaos – mine's a disaster zone.
¡Vaya, esto sí que es un cambio radical! 🤯 Microsoft parece decidido a que su IA lo vea TODO. Por un lado, es super útil para productividad (¡adiós al copiar y pegar entre apps!), pero por otro... ¿qué tan cómodo te sentirías sabiendo que un asistente analiza cada píxel de tu pantalla constantemente? Me pregunto sobre el procesamiento de datos privados o incluso sesiones bancarias.
Microsoft is introducing an update to Copilot Vision for Windows Insiders, enabling the AI tool to analyze everything displayed on your screen. Previously limited to viewing two applications simultaneously and connecting information between them, the tool can now examine your entire desktop or any specific browser or application window, according to Microsoft.
Unlike Recall, which automatically captures periodic snapshots of your computer screen, using Copilot Vision resembles screen sharing during a video call. You can activate the feature by clicking the glasses icon within the Copilot app and selecting the desktop you want it to observe.
Image: MicrosoftAccording to Microsoft, Copilot Vision can "help analyze content, deliver insights, and answer your questions, guiding you through the process verbally." The company adds, "Get advice for refining your creative projects, assistance with enhancing your resume, or support while navigating unfamiliar games."
Microsoft initially launched testing for Copilot Vision last year as a feature capable of interpreting content viewed in the Edge browser. The tool can also respond to questions about visual input captured through your mobile phone's camera.
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
Wait, so Microsoft's Copilot can now watch everything on my screen? That's both impressive and mildly terrifying. 😅 I mean, sure, it could help with multitasking or finding info faster, but privacy-wise, this feels like a whole new level of surveillance. Hope they're transparent about what data gets stored or shared. Also, curious how well it handles messy desktop chaos – mine's a disaster zone.
¡Vaya, esto sí que es un cambio radical! 🤯 Microsoft parece decidido a que su IA lo vea TODO. Por un lado, es super útil para productividad (¡adiós al copiar y pegar entre apps!), pero por otro... ¿qué tan cómodo te sentirías sabiendo que un asistente analiza cada píxel de tu pantalla constantemente? Me pregunto sobre el procesamiento de datos privados o incluso sesiones bancarias.





Home






