Microsoft Copilot Studio is integrating AI advancements into the business world. Following the general availability of deep reasoning capabilities, model context protocol (MCP) support, and agent flows last month, more developments were announced today.
Microsoft Copilot Studio is launching automation in desktop and web applications
Microsoft has added a computer-aware feature to Copilot Studio as an early access research preview. This new capability allows Copilot Studio agents to use websites and desktop applications as tools. With computer-awareness, agents can now interact with any system with a graphical user interface.
Computer-awareness gives agents the ability to click on-screen buttons, select menus, and type text into fields. This allows them to manage tasks even when there is no API to connect directly to the system. Agents can use any application that a human can use.
This new technology automatically adapts to changes in applications and websites. It uses built-in reasoning to solve problems on its own in real time, without interrupting the workflow. It is also built on Copilot Studio’s robust security and governance frameworks, ensuring compliance with enterprise and industry standards.
With the computational feature in Copilot Studio, developers can create agents that automate tasks in user interfaces across both desktop and browser applications such as Edge, Chrome, and Firefox.
This technology runs on Microsoft infrastructure, meaning organizations don’t have to manage their own servers. Enterprise data remains within the Microsoft Cloud and isn’t used to train the Frontier model. This helps organizations speed deployment, reduce maintenance costs, and lower infrastructure costs.
Computational features enable many high-value scenarios. In an automated data entry scenario, a business can import large amounts of data from multiple sources into a centralized system.
Marketing teams can automate the collection of data from multiple online sources for market research. Finance departments can streamline the process of extracting data from invoices and entering it into accounting systems.
Computational agents are transforming robotic process automation (RPA). They overcome traditional limitations, such as the fragility of user interface elements, and can manage complex dynamic interfaces. This makes automation accessible to people other than professional RPA developers.
The computer usage in Copilot Studio overcomes common RPA challenges by providing more intelligent and intuitive automation. When buttons or screens change, the tool continues to work without disrupting the workflow.
It can be used without coding, with instructions defined in natural language, and can be tested with real-time side-by-side video playback. The agent can make intelligent decisions even in complex environments by seeing what is on the screen. Developers can view a history of computer usage activity, including captured screenshots and logic steps.
Microsoft Copilot Studio stands out as an end-to-end agent platform designed to help organizations achieve their AI and operational goals. Those who want to try this new feature can fill out a form. Microsoft also says it will share more information about this new announcement at Microsoft Build in May 2025.
{{user}} {{datetime}}
{{text}}