Microsoft Allows Copilot Studio to Operate Computer Independently
This week, Microsoft rolled out an exciting new feature for Copilot Studio called "computer use," which allows AI agents to interact with websites and desktop applications in a way that feels almost human. Think of it as giving your AI a pair of digital hands to click buttons, navigate menus, and type into fields on the screen. It's a game-changer, especially for businesses looking to automate tasks without the need for direct API connections.
Charles Lamanna, the corporate vice president of Microsoft's business & industry Copilot, put it this way: "Computer use enables agents to interact with websites and desktop apps by clicking buttons, selecting menus, and typing into fields on the screen. This allows agents to handle tasks even when there is no API available to connect to the system directly. If a person can use the app, the agent can too." It's like giving your AI a license to operate any software tool you use daily.

*The new computer use tool in Copilot Studio.* Image: Microsoft
With this new capability, Copilot Studio can craft AI agents that take on a variety of tasks, from data entry to market research, and even invoice processing. What's more, these AI agents are smart enough to adapt when apps or websites update their interfaces. They won't just stop working because a button moved or a screen changed; they'll keep going, ensuring your automation stays on track.
Microsoft isn't stopping there. Earlier this month, they introduced a similar feature called Actions for their consumer Copilot. These Actions can run in the background, freeing you up to focus on other tasks while Copilot books your restaurant reservations, snags event tickets, or shops online for you. However, the Actions feature is currently limited to a select group of partners. On the other hand, Copilot Studio's "computer use" feature seems poised to play nicely with a broader range of websites and apps, offering more flexibility for businesses.
Related article
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
Related Special Topic Recommendations
Comments (13)
0/500
So Microsoft is essentially giving AI a pair of digital hands? That's both exciting and terrifying. Can't wait for my AI to accidentally delete my files while trying to order pizza 🍕
This 'computer use' feature is wild! It's like giving AI a driver's license for your desktop. I'm curious how it'll handle my messy browser tabs. 😅 Anyone else worried about it clicking the wrong button?
This 'computer use' feature sounds wild! It's like giving AI a driver's license to cruise through apps and websites. I'm curious how secure this is—hope Microsoft’s got tight locks on this digital puppet master. 😎
¡La nueva función de Copilot Studio de Microsoft es impresionante! Es como si mi IA tuviera manos y pudiera navegar por mi computadora como un profesional. Muy útil para automatizar tareas repetitivas, pero a veces clickea el botón equivocado. Aún así, ¡un cambio de juego! 🤖💻
Microsoft's new feature in Copilot Studio is mind-blowing! It's like my AI has grown hands and can now click around on my computer. Super useful for automating repetitive tasks, but it still feels a bit spooky watching it work. Anyone else creeped out by this? 🤔 Give it a try, but maybe keep an eye on what it's doing!
This week, Microsoft rolled out an exciting new feature for Copilot Studio called "computer use," which allows AI agents to interact with websites and desktop applications in a way that feels almost human. Think of it as giving your AI a pair of digital hands to click buttons, navigate menus, and type into fields on the screen. It's a game-changer, especially for businesses looking to automate tasks without the need for direct API connections.
Charles Lamanna, the corporate vice president of Microsoft's business & industry Copilot, put it this way: "Computer use enables agents to interact with websites and desktop apps by clicking buttons, selecting menus, and typing into fields on the screen. This allows agents to handle tasks even when there is no API available to connect to the system directly. If a person can use the app, the agent can too." It's like giving your AI a license to operate any software tool you use daily.

With this new capability, Copilot Studio can craft AI agents that take on a variety of tasks, from data entry to market research, and even invoice processing. What's more, these AI agents are smart enough to adapt when apps or websites update their interfaces. They won't just stop working because a button moved or a screen changed; they'll keep going, ensuring your automation stays on track.
Microsoft isn't stopping there. Earlier this month, they introduced a similar feature called Actions for their consumer Copilot. These Actions can run in the background, freeing you up to focus on other tasks while Copilot books your restaurant reservations, snags event tickets, or shops online for you. However, the Actions feature is currently limited to a select group of partners. On the other hand, Copilot Studio's "computer use" feature seems poised to play nicely with a broader range of websites and apps, offering more flexibility for businesses.
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
So Microsoft is essentially giving AI a pair of digital hands? That's both exciting and terrifying. Can't wait for my AI to accidentally delete my files while trying to order pizza 🍕
This 'computer use' feature is wild! It's like giving AI a driver's license for your desktop. I'm curious how it'll handle my messy browser tabs. 😅 Anyone else worried about it clicking the wrong button?
This 'computer use' feature sounds wild! It's like giving AI a driver's license to cruise through apps and websites. I'm curious how secure this is—hope Microsoft’s got tight locks on this digital puppet master. 😎
¡La nueva función de Copilot Studio de Microsoft es impresionante! Es como si mi IA tuviera manos y pudiera navegar por mi computadora como un profesional. Muy útil para automatizar tareas repetitivas, pero a veces clickea el botón equivocado. Aún así, ¡un cambio de juego! 🤖💻
Microsoft's new feature in Copilot Studio is mind-blowing! It's like my AI has grown hands and can now click around on my computer. Super useful for automating repetitive tasks, but it still feels a bit spooky watching it work. Anyone else creeped out by this? 🤔 Give it a try, but maybe keep an eye on what it's doing!





Home






