Google’s Gemini Can Now Control Mac Devices on Users’ Behalf
The new ability, called “computer use,” lets the assistant help with clicking, typing, navigating menus and filling forms
By : Bloomberg
Update: 2026-11-20 11:18 GMT
Google’s Gemini can now take control of Mac computers to complete tasks for users, matching a feature already offered by other popular AI assistants and raising the pressure on Apple to make Siri more capable.
The new ability, called “computer use,” lets the assistant help with clicking, typing, navigating menus and filling forms, Google said Thursday. For example, the company said Gemini can help with color-grading a batch of photos using one’s preferred design software, or analyze photos of clothing stored in a computer folder and prepare them to be listed on resale websites.
Computer use is available now for people in the US with the Mac Gemini app who are subscribed to Google AI Plus, Pro or Ultra plans.
Tech and AI companies have been intensely focused on developing AI agents that can do things on behalf of the user, an advancement beyond question-and-answer chatbots. Aside from Google, OpenAI’s ChatGPT and Meta’s Muse have had a similar computer-use feature for their Mac software so their chatbots can interact with users’ local computer files and other apps.
When Google’s new tool is active, consumers are free to use their main screen and cursor while Gemini works in an isolated background window. Users can also “choose which apps Gemini can access, watch every step live, pause at any time, and approve key actions before they happen,” the company added.
The new feature also ratchets up the pressure on Apple to make its Siri assistant more capable. The current version of Siri can handle tasks in Apple’s own apps — for example, sending iMessages or adding calendar appointments. But its powers don’t extend to most third-party software. That could soon change, however: The iPhone maker has released frameworks that let outside developers enable those abilities in their apps.
Apple’s tension with third-party AI tools could grow as more agents introduce a computer-use feature. Apple has pledged to introduce new privacy controls on Macs after warning of rising risks from granting broad data access to AI software.