we_are_coded.by CODE · The world, decoded
БГ
Google

Gemini now sees the screen and acts on its own

GoogleFrontier

Google built 'computer use' directly into Gemini 3.5 Flash. The agent sees the screen, reasons and clicks - in browser, on mobile, on desktop. Not a separate product. Part of the model.

In short
  • Google built computer use directly into Gemini 3.5 Flash (June 24): the agent sees, reasons and clicks on its own.
  • Works in browser, mobile and desktop environments; aimed at long, multi-step tasks.
  • Safeguards: training against misuse, confirmation on sensitive actions and prompt injection detection.
Checked on30 June 2026Responsible editorTsvetelin IvanovHow we workMethod · Corrections

The agent looks at your screen and clicks instead of you. Google built 'computer use' directly into Gemini 3.5 Flash - it sees the interface, reasons and acts in browser, on mobile and on desktop.

Safeguards: targeted training against misuse plus optional enterprise safeguards - confirmation on sensitive actions and detection of prompt injection. Access through the Gemini API and Enterprise Agent Platform; aimed at long, multi-step tasks.

Here I see the same line as with OpenAI and Anthropic - the model stops waiting to be asked and starts taking steps on its own. Google adds something important on top - safeguards for sensitive actions and protection against command injection.

The ability for an agent to click instead of you is the easy part. The hard part is putting brakes in the right places. That the two arrive together here, not patched on later, is why I'd run it on a real browser. With the others I'd still wait.

Risk / caveat

An agent that acts on its own on screen effectively needs an allowlist, confirmation on sensitive actions, logs and sandbox, not blind trust.

The visual is generated code art. No third-party images.
Follow usFacebookLinkedIn
Official primary sources
→Google - Computer use in Gemini 3.5 Flash
Original: https://wearecoded.com/en/articles/gemini-computer-use.html
ShareFacebookXLinkedInTelegramWhatsApp
← Back to all news