Microsoft Copilot Now Enhances Edge with Screen Viewing Capability

Microsoft's AI assistant, Copilot Vision, which can analyze your screen and assist with various tasks, is now accessible for free within the Edge browser. This exciting update was shared by Microsoft AI's CEO, Mustafa Suleyman, via Bluesky today. Copilot Vision offers a unique "talk-based experience," where you simply speak your commands and wait for Copilot to respond.
According to Suleyman, if you choose to enable Copilot Vision, it can "literally see what you see on screen." Imagine having it guide you through a recipe as you cook, or even decoding job descriptions to help you prepare for interviews or brainstorm cover letter ideas. However, it's worth noting that using AI for your resume might not always be the best approach. As per Microsoft's support page, Copilot Vision can highlight parts of your screen to pinpoint relevant information, but it won't click links or take actions on your behalf.
While the broader, system-wide features of Copilot Vision remain exclusive to Copilot Pro subscribers, the free version within Edge is still quite powerful. With a subscription, Vision can extend beyond Edge to assist with tasks in applications like Photoshop or video editing software, or even guide you through games like *Minecraft*, as demonstrated by *The Verge*'s Tom Warren earlier this month.
To give Copilot Vision a try, simply open this link to Microsoft's website in the Edge browser. You should be prompted to opt into the feature. Once you've granted permission, you can activate the Copilot sidebar on any website, click the microphone icon, and start your Vision session, which will be marked by a chime and a change in your browser's hue.
However, my experience wasn't as smooth as expected. It took a few attempts before Edge asked me to opt in, and even after opting in and starting a Vision session, the controls didn't appear. Instead, I was left with a persistent message saying "One moment…" at the bottom of my browser. Keep in mind, I'm using an older, less powerful laptop, so your experience might be different.
Microsoft assures users that while they log Copilot's responses, they do not collect your inputs, images, or page content during a Copilot Vision session. To stop sharing your screen, you can end the session or simply close the browser window.
Related article
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
Related Special Topic Recommendations
Comments (25)
0/500
So Microsoft's Copilot can now see my screen? Great, another 'helpful' AI that's basically a digital peeping Tom. 🙄 I wonder if it'll start suggesting I close my 47 open tabs or just judge my browsing history silently. Fun times ahead!
¡Increíble lo rápido que avanza Microsoft! 😮 Ahora el Copilot puede ver mi pantalla en Edge... ¿pero qué tan seguro es esto? Me encanta la idea de ayuda, pero también me preocupa la privacidad. ¿Alguien más ha probado esta función?
This screen-viewing feature in Edge is wild! Copilot Vision feels like having a super-smart buddy looking over your shoulder, helping with whatever you're doing. Can't wait to see how it handles my chaotic browsing habits! 😎
Wow, Copilot Vision in Edge sounds like a game-changer! Analyzing my screen for free? I'm curious how it handles privacy, though—hope it’s not secretly judging my messy desktop! 😅

Microsoft's AI assistant, Copilot Vision, which can analyze your screen and assist with various tasks, is now accessible for free within the Edge browser. This exciting update was shared by Microsoft AI's CEO, Mustafa Suleyman, via Bluesky today. Copilot Vision offers a unique "talk-based experience," where you simply speak your commands and wait for Copilot to respond.
According to Suleyman, if you choose to enable Copilot Vision, it can "literally see what you see on screen." Imagine having it guide you through a recipe as you cook, or even decoding job descriptions to help you prepare for interviews or brainstorm cover letter ideas. However, it's worth noting that using AI for your resume might not always be the best approach. As per Microsoft's support page, Copilot Vision can highlight parts of your screen to pinpoint relevant information, but it won't click links or take actions on your behalf.
While the broader, system-wide features of Copilot Vision remain exclusive to Copilot Pro subscribers, the free version within Edge is still quite powerful. With a subscription, Vision can extend beyond Edge to assist with tasks in applications like Photoshop or video editing software, or even guide you through games like *Minecraft*, as demonstrated by *The Verge*'s Tom Warren earlier this month.
To give Copilot Vision a try, simply open this link to Microsoft's website in the Edge browser. You should be prompted to opt into the feature. Once you've granted permission, you can activate the Copilot sidebar on any website, click the microphone icon, and start your Vision session, which will be marked by a chime and a change in your browser's hue.
However, my experience wasn't as smooth as expected. It took a few attempts before Edge asked me to opt in, and even after opting in and starting a Vision session, the controls didn't appear. Instead, I was left with a persistent message saying "One moment…" at the bottom of my browser. Keep in mind, I'm using an older, less powerful laptop, so your experience might be different.
Microsoft assures users that while they log Copilot's responses, they do not collect your inputs, images, or page content during a Copilot Vision session. To stop sharing your screen, you can end the session or simply close the browser window.
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
So Microsoft's Copilot can now see my screen? Great, another 'helpful' AI that's basically a digital peeping Tom. 🙄 I wonder if it'll start suggesting I close my 47 open tabs or just judge my browsing history silently. Fun times ahead!
¡Increíble lo rápido que avanza Microsoft! 😮 Ahora el Copilot puede ver mi pantalla en Edge... ¿pero qué tan seguro es esto? Me encanta la idea de ayuda, pero también me preocupa la privacidad. ¿Alguien más ha probado esta función?
This screen-viewing feature in Edge is wild! Copilot Vision feels like having a super-smart buddy looking over your shoulder, helping with whatever you're doing. Can't wait to see how it handles my chaotic browsing habits! 😎
Wow, Copilot Vision in Edge sounds like a game-changer! Analyzing my screen for free? I'm curious how it handles privacy, though—hope it’s not secretly judging my messy desktop! 😅





Home






