Asserting laptop use in Copilot Studio! This new function permits your Copilot Studio brokers to work together straight with web sites and desktop purposes. Need to be a part of the restricted preview? Learn on.
AI innovation is accelerating at an unprecedented tempo, and Microsoft Copilot Studio is on the forefront—integrating the very best AI developments right into a platform constructed to resolve enterprise challenges at scale. Final month, we launched deep reasoning capabilities for brokers, help for mannequin context protocol (MCP), and the final availability of agent flows in Copilot Studio.
At the moment, we’re excited to announce that laptop use is coming to Copilot Studio by means of an early entry analysis preview. This new functionality permits your Copilot Studio brokers to deal with web sites and desktop purposes as instruments. With laptop use, brokers can now work together with any system that has a graphical person interface!
Obtain new efficiencies with laptop use
Pc use allows brokers to work together with web sites and desktop apps by clicking buttons, deciding on menus, and typing into fields on the display screen. This permits brokers to deal with duties even when there isn’t a API accessible to connect with the system straight. If an individual can use the app, the agent can too.
Pc use adapts to modifications in apps and web sites mechanically. It adjusts in actual time utilizing built-in reasoning to repair points by itself, so work continues with out interruption. It’s also constructed on Copilot Studio’s sturdy safety measures and governance frameworks, to assist guarantee compliance with organizational and trade requirements.
With laptop use in Copilot Studio, makers can construct brokers that automate duties on person interfaces throughout each desktop and browser purposes, together with Edge, Chrome, and Firefox. Moreover, laptop use runs on Microsoft-hosted infrastructure, that means organizations don’t have to handle their very own servers. Enterprise knowledge stays inside Microsoft Cloud boundaries and isn’t used to coach the Frontier mannequin. This helps your group speed up deployment, scale back upkeep, and decrease infrastructure prices.
Unlock new worth with agentic and automation eventualities
To carry this know-how to life, contemplate the next excessive worth use instances:
- Automated knowledge entry: Think about a situation the place an enterprise must enter massive volumes of knowledge from numerous sources right into a centralized system. Pc use can automate this course of, lowering handbook effort and minimizing errors.
- Market analysis: Advertising and marketing groups can leverage the device to automate the gathering of market knowledge from numerous on-line sources for evaluation, offering helpful insights with out the necessity for handbook intervention.
- Bill processing: For finance departments, the device can automate the extraction of knowledge from invoices and enter it into accounting methods, streamlining your complete invoicing course of and lowering handbook errors.
Reimagining robotic course of automation (RPA)
Pc use brokers are remodeling robotic course of automation (RPA). They overcome conventional limitations, just like the fragility of UI components, and may deal with advanced dynamic interfaces. This makes automation accessible to individuals past skilled RPA builders.
In Copilot Studio, laptop use addresses frequent RPA challenges by making automation smarter and extra intuitive:
- It responds to modifications in actual time: When buttons or screens change, the device retains working with out breaking your circulation.
- It’s simple to make use of: You possibly can describe what you need in pure language, no coding wanted, and check and refine the immediate with real-time side-by-side video of the pc use reasoning chain and the deliberate UI automation.
- It’s constructed with intelligence: The agent sees what’s on the display screen and makes sensible choices in actual time, even in advanced or continuously altering environments.
- It comes with full visibility: Makers can view a historical past of laptop use exercise at will, together with captured screenshots and reasoning steps.
The way forward for innovation with Copilot Studio
Copilot Studio is the end-to-end agent platform designed to assist organizations obtain their AI and operational objectives. We wish to empower you to streamline processes, improve productiveness, and drive innovation.
If you’re eager about exploring the brand new laptop use functionality, we might love to listen to from you! Please fill out this manner to tell us you wish to take part.
We may also share extra about this new announcement at Microsoft Construct in Could 2025—register right here to hitch us!