Close Menu
GeekBlog

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    Best Smartwatch for Weight Loss in 2026: What Actually Works

    November 20, 2026

    Gemini Can Now Click Around Your Mac for You. Apple Is Building Its Own Agent and Changing the Locks.

    November 20, 2026

    Meta’s Muse Agent Read Signal Messages Through a Side Door. Here’s How to Lock It Out.

    November 20, 2026
    Facebook
    GeekBlog
    • Home
    • Mobile
    • Tech News
    • Blog
    • Gaming
    • Smartwatch
    • How-To Guides
    • AI & Software
    Facebook
    GeekBlog
    Home»AI & Software»Gemini Can Now Click Around Your Mac for You. Apple Is Building Its Own Agent and Changing the Locks.
    AI & Software

    Gemini Can Now Click Around Your Mac for You. Apple Is Building Its Own Agent and Changing the Locks.

    Olivia HartmanBy Olivia HartmanNovember 20, 20268 Mins Read
    Share Facebook Twitter Pinterest LinkedIn Tumblr Email Copy Link
    Person holding an Apple MacBook Pro laptop
    Photo via Pexels
    Share
    Facebook Twitter LinkedIn Pinterest Email Copy Link

    Google wants Gemini to do the boring clicking for you. As of this week, the Gemini app for Mac can take a plain English request, open the apps it needs, type, fill out forms and move through websites until the job is done. You watch it happen in a small live preview, and your own mouse never moves.

    The feature is called computer use, and Google is fairly late to it. OpenAI, Anthropic and Meta already ship agents that can operate a desktop. What’s interesting is the timing. The same week Gemini learned to drive a Mac, Bloomberg spotted Apple hiring someone to build “an AI agent that can use a computer,” and Apple pushed a macOS update that makes it much harder for outside agents to take full control. The fight over who gets to run your computer just got a lot more crowded.

    The short version

    • What: Gemini for Mac can now operate local files, desktop apps and websites on your behalf
    • Where: US only, English only, for now
    • Who: Google AI Plus, Pro and Ultra subscribers, 18 and older, on personal accounts
    • Hardware: Apple Silicon Mac running macOS Sequoia 15.0 or later
    • Safety net: you pick which apps it can touch, watch every step, pause anytime and approve key actions
    • Meanwhile: Apple is building its own Mac agent and tightening permissions for everyone else

    How Gemini’s computer use works

    The main design choice is where the agent does its work. Instead of hijacking your screen, Gemini runs inside an isolated background window, and a live preview of what it’s doing appears in your chat. “Your main screen and cursor remain completely free, so you can keep typing, designing, or taking calls without interruption,” Google says in its announcement.

    Based on Google’s post and early hands-on reports, using it looks like this:

    1. Open the Gemini app for Mac and type your request in the chat, adding @Computer use to call the feature.
    2. Choose which apps Gemini may access. New desktop connectors, including Blender and Autodesk Fusion, show up under Customize > Connectors, according to 9to5Google.
    3. Let it work in the background window while you keep doing your own thing.
    4. Watch the live preview and pause it whenever something looks off.
    5. Approve key actions before they happen. Gemini also stops for logins and payments.

    That approval step is the important one, and it’s also the vaguest. Google says Gemini asks before “key actions,” but it doesn’t define which actions count as key. Until that’s spelled out, assume anything involving money, sending messages or deleting files deserves a close look.

    What Google thinks you’ll use it for

    Google’s examples lean heavily toward chores that normally take dozens of clicks. Its own promo shows someone asking Gemini to take a kid’s butterfly sketch, model it and rig it in Blender.

    Recommended for you:

    Meta’s Muse Agent Read Signal Messages Through a Side Door. Here’s How to Lock It Out.
    AI & Software·Nov 20, 2026

    Meta’s Muse Agent Read Signal Messages Through a Side Door. Here’s How to Lock It Out.

    Google’s exampleWhat Gemini actually doesTouches the web?
    Creative workflowsBatch color-grades photos in design software or builds 3D scenesNo
    Shipping quotesPulls weights, dimensions and addresses from local PDFs into multi-field formsYes
    Presentation decksGrabs metrics and screenshots from live dashboards and builds a Google Slides deckYes
    Resale listingsAnalyzes clothing photos, researches prices, logs details and stages listingsYes

    Three of the four involve websites, which raises a question Google hasn’t answered yet: how Gemini identifies itself to the sites it visits. Retailers and banks are already split on agents. Some build special lanes for them, others block them, and several big US banks now say you’re responsible for anything an AI agent does with your login. Worth keeping in mind before you point Gemini at an account that holds money.

    Google’s year of building a Mac agent, one piece at a time

    Computer use didn’t come out of nowhere. Google has used the Mac as a testing ground for desktop agents most of this year, adding a capability every month or two.

    How Gemini grew into a Mac agent in 2026 Key releases, based on Google announcements and news reports Apr 15 Native Gemini app for Mac launches, free to download Jun 30 Gemini Spark agent arrives on macOS for AI Ultra subscribers Jul 29 Voice control over any open app and Fn key dictation Jul 30 Spark expands to AI Pro in 160+ more countries Sep 10 Gemini becomes an installable Windows app (Alt + Space) Oct 13 Tasks mode keeps working while you’re away (Pro, Ultra) Nov 17 Tasks goes free in six countries, Spark renamed Tasks Nov 19 Computer use: Gemini operates Mac apps for paying US users

    Look closely at the last two entries and you’ll see Google’s pricing strategy. The task agent that works with your files and connected Google services went free in the US two days before computer use launched. The part that actually drives your screen and other programs starts at a paid tier. Google has split its desktop agent into a free layer that handles your stuff and a paid layer that operates your machine.

    Who can turn it on today

    RequirementDetails
    ComputerApple Silicon Mac (M-series). Intel Macs are left out
    Operating systemmacOS Sequoia 15.0 or newer
    SubscriptionGoogle AI Plus, Pro or Ultra. Free accounts don’t get it
    Account typePersonal Google account, age 18+. Work and school accounts are excluded
    Region and languageUnited States, English only. No date given for other markets
    WindowsNot included yet, even though Gemini has a Windows app

    Apple wants an agent of its own

    The job listing Bloomberg found reads like a product pitch. Apple is looking for a senior engineering manager to oversee an “AI agent that can use a computer.”

    “Imagine an AI agent that can use a computer the way a capable person does. It browses the web, works across apps, runs commands, writes and debugs code, and calls services, and it chooses the right tool for each step. It does all this privately and with the polish people expect from Apple.”
    Apple job listing, as reported by Bloomberg

    Don’t hold your breath. Bloomberg says Apple has looked at launching it as soon as the end of next year, but the work “remains in the early stages.” It also fits a broader push. Bloomberg reported earlier this month that Apple wants to turn Siri into an autonomous agent that gets things done for you. Microsoft is on the same path, and is already rebuilding Windows around AI agents.

    And it’s making outside agents work harder for access

    Here’s where it gets awkward for Google, Meta and everyone else. While Apple builds its own agent, macOS 27.3 raises the bar for third-party ones. Apple told developers in October that users who “genuinely wish to grant an app this extraordinary level of access” should only be able to do it “with very explicit user action.” The update follows through:

    • The old all-in-one setting is split. Early beta coverage describes a broad “System & App Protection Override” permission for apps that need to control other software, separate from a narrower Accessibility permission.
    • Louder warnings. macOS will now discourage people from handing full control to outside agents.
    • Accessibility goes back to its purpose. Apple is sharply restricting developers’ use of accessibility tools on Macs and adding a new set of permissions built for agents.
    • Old grants don’t vanish. Permissions you already approved can stay active after the update.

    Apple has a fresh reason to do this. Reuters found this week that Meta’s Muse agent read Signal messages on a Mac by combining Accessibility and screenshot permissions, without using any official Signal connection. Apple says its update closes that pathway.

    Recommended for you:

    Nvidia Just Made $115.8 Billion Without Jensen Huang. Then It Started Undoing His Playbook.
    AI & Software·Nov 18, 2026

    Nvidia Just Made $115.8 Billion Without Jensen Huang. Then It Started Undoing His Playbook.

    Worth knowing: Apple’s caution cuts both ways. Tighter permissions protect you from overreaching agents, but they also make life harder for rivals right as Apple prepares its own. Expect the “privacy versus competition” argument to get loud once Apple’s agent ships.

    Before you let Gemini drive

    Computer use is genuinely handy for repetitive work, and Google’s background window design is a smart way to keep the agent from fighting you for the cursor. A few habits will keep it from becoming a headache:

    1. Start with low-stakes jobs. Renaming files, sorting folders or filling a form you’ll review yourself are perfect first tests.
    2. Grant apps one at a time. Only connect the apps a task needs, and remove them afterward if you won’t use them again soon.
    3. Actually watch the preview the first few times. You’ll learn quickly where it gets confused.
    4. Keep it away from banking and shopping logins until Google explains what “key actions” covers and how it handles sites that restrict agents.
    5. Review your Mac permissions after macOS 27.3. Open System Settings > Privacy & Security and check which apps still hold Accessibility, Screen Recording and Full Disk Access.
    6. Remember what you share. Anything Gemini sees while working may end up in your chat history, and Google recently changed how long it keeps “History Off” chats.

    A year ago, an AI that could click through your apps was a demo. Now Google, Meta, OpenAI and Anthropic all sell one, and Apple is hiring to build its own. The real question is who controls the permissions screen, and on the Mac, that’s still Apple.

    About this article: GeekBlog covers U.S. technology news, AI, phones, smartwatches and gaming. Every story is written and checked under our Editorial Policy. Spotted a mistake or have a story tip? Contact our editors.

    AI agents Apple Computer use Google Gemini macOS
    Share. Facebook Twitter Pinterest LinkedIn Tumblr Telegram Email Copy Link
    Previous ArticleMeta’s Muse Agent Read Signal Messages Through a Side Door. Here’s How to Lock It Out.
    Next Article Best Smartwatch for Weight Loss in 2026: What Actually Works
    Olivia Hartman

      Olivia Hartman is GeekBlog's general technology reporter, covering the wider world of tech beyond smartphones: AI and software, laptops and PCs, gaming, streaming, space, science, consumer gadgets, deals and the policy stories shaping the industry. A versatile journalist with a nose for what actually matters, Olivia turns breaking news and product launches into accessible, no-hype reporting for everyday readers.

      Related Posts

      10 Mins Read

      Meta’s Muse Agent Read Signal Messages Through a Side Door. Here’s How to Lock It Out.

      7 Mins Read

      A Vegan of 14 Years Just Ordered Chicken at a Steakhouse. It Was Grown in a Steel Tank From One Egg.

      7 Mins Read

      Palmer Luckey Says His $1 Billion Floating City Isn’t a Data Center. It’s Built to Last 1,000 Years.

      6 Mins Read

      GTA 6 Is Crashing Every Few Minutes for Some Xbox Series X Owners. Here’s What Actually Helps.

      8 Mins Read

      A YouTuber Stayed Awake for 84 Hours Until He Hallucinated. Science Saw It Coming Hour by Hour.

      9 Mins Read

      Citi Says You Pay if Your AI Agent Gets Hacked. Six Big Banks Have Now Changed Their Rules.

      Top Posts

      Every iPhone Camera Ranked in 2026 (Best to Worst)

      July 6, 2026373 Views

      Best Browser for Android in 2026: Top Picks Ranked

      July 7, 2026209 Views

      Apple Watch Black Friday 2026: Early Deals, Prices to Beat and When to Buy

      November 8, 2026203 Views
      Stay In Touch
      • Facebook

      Subscribe to Updates

      Get the latest tech news from FooBar about tech, design and biz.

      Most Popular

      Apple Watch Black Friday 2026: Early Deals, Prices to Beat and When to Buy

      November 8, 2026340 Views

      One UI 9 Watch: Which Galaxy Watches Get Wear OS 7, and Who Gets Left Behind

      November 6, 2026186 Views

      Garmin Lily 2 Review: Lily 2 vs Active vs Classic in 2026

      November 6, 2026103 Views
      Our Picks

      Best Smartwatch for Weight Loss in 2026: What Actually Works

      November 20, 2026

      Gemini Can Now Click Around Your Mac for You. Apple Is Building Its Own Agent and Changing the Locks.

      November 20, 2026

      Meta’s Muse Agent Read Signal Messages Through a Side Door. Here’s How to Lock It Out.

      November 20, 2026

      Subscribe to Updates

      Get the latest creative news from FooBar about art, design and business.

      HEICJPG.online - Convert HEIC to JPG online
      Facebook
      • About GeekBlog: Our Mission, Team and Editorial Standards
      • Contact us
      • Privacy Policy
      • Disclaimer
      • Terms and Conditions
      • Editorial Policy
      • Cookie Policy
      • Your Privacy Choices
      © 2026 GeekBlog

      Type above and press Enter to search. Press Esc to cancel.