Computer Use
"Point it at any application by name. It clicks, types, drags, and reads back what changed."
Watch It Work
How It Works
The monitor tiles your screen into regions, runs each through a vision model, and builds a persistent element map. That map stays live until the screen actually changes. Incremental updates mean a single chess move rescans 2 tiles, not the whole screen.
The screen is divided into vision tiles. Each tile runs through a vision model and returns labelled elements with positions — Submit button, File menu, search input. The full map persists until something changes.
Every action uses natural language: clickElement("Save button"), dragElement("D2 pawn", "D4 square"), typeIntoElement("search box", "hello"). The agent never sees or passes pixel coordinates.
Every action returns whether the screen changed, by how much, and how long it took to settle. Background animations — CSS transitions, floating particles — are automatically subtracted so the agent knows if its click did something vs. hit dead space.
After the initial scan, only tiles that visually change get re-scanned. A chess move rescans 2 tiles, not the whole screen. Large transitions like navigating to a new page automatically invalidate the full cache and trigger a fresh scan.
Full keyboard and mouse coverage, plus timing primitives for flows that depend on UI settling before the next action.
Compatibility
Computer Use is not a browser automation tool or a web scraper. It operates at the OS input level using native Windows APIs, so it works with anything rendered on screen — not just web content.
Honest Context
Computer Use is observe-think-act, not continuous control. It is built for automation workflows, not reflex-driven interaction. Here is what to expect.
A 2560×1440 screen produces 8 vision tiles per full scan. Cloud models process tiles in parallel — 2–3 seconds. Local vision models run sequentially — expect 20–40+ seconds depending on hardware.
Label quality scales with the vision model. Labels can be inconsistent between scans — “Submit” vs “Submit button” — and small or visually ambiguous elements may be missed or mislabelled.
Uses native Windows input APIs. macOS and Linux are not supported in the current release.
Multi-monitor setups work, but you start a monitor on one display at a time. You can switch between monitors; simultaneous dual-monitor sessions are not currently supported.
Each interaction round takes seconds, not milliseconds. Great for automation workflows and UI testing. Not suitable for twitch gaming, real-time video playback control, or anything requiring sub-second reaction.
The agent scans, reasons, then acts — one step at a time. It does not maintain a continuous stream of screen awareness between actions. Each action is a deliberate, complete round-trip.
"If you can see it, the agent can interact with it."— that is the entire design goal
Any app. Any workflow. Zero coordinates.
Buy Now — $79 ← Explore More Features