Beginner24 min read

Claude 101(16) — Let Claude Click, Type and Drive Apps For You With Computer Use

Learn how to use Computer Use to automate repetitive web forms, multi-site comparisons, and bulk admin tasks. Claude can fill forms, click buttons, and supervise itself with screenshots.

Claude 101(16) — Let Claude Click, Type and Drive Apps For You With Computer Use

Overview

Most automation needs a clean API. The annoying jobs in real life don't have one — government visa forms, insurance portals, legacy admin systems, sites that hate keyboard shortcuts. Computer Use is Claude looking at your screen and using your mouse and keyboard like a careful intern. It can fill forms, click through wizards, copy data between websites, and supervise itself with screenshots. In this guide, we'll enable Computer Use, walk through three real jobs (form-fill, multi-site price compare, bulk admin upload), and lock in the safety habits that keep things predictable.

Who This Is Useful For

  • People who fill out long, repetitive web forms (visa applications, school registrations, insurance claims)
  • Anyone with admin tasks in a clunky legacy system at work or for a hobby
  • Folks who want to compare data across 10+ sites without keeping 10 tabs open
  • What You Will Build

    A working Computer Use setup with three battle-tested workflows:

  • Form-fill helper — Claude reads your stored info and fills repetitive web forms accurately
  • Multi-site price comparison — Claude visits 5–10 retailer sites for the same product and reports a clean comparison
  • Bulk admin upload — Claude uploads a list of items into a legacy portal, one row at a time, with verification
  • What You Need

  • A Claude Pro account
  • Computer Use enabled (Settings → Desktop app → Computer use → toggle on)
  • The Cowork desktop app installed (Article 11) — Computer Use lives inside it
  • 30 minutes
  • A real, repetitive job that involves clicking and typing on websites
  • Step 1: Computer Use vs Other Claude Tools

    Three tools sound similar; they're for different jobs:

  • Claude for Chrome (Article 06) — limited to a Chrome tab. Best for browser-only tasks like email triage.
  • Cowork (Article 11) — controls files on your computer. Doesn't operate apps or browsers.
  • Computer Use — sees the whole screen, drives the mouse and keyboard. Best when a task spans multiple apps, or involves a clunky non-browser app, or needs visual verification.
  • If a task happens entirely in Chrome, Claude for Chrome is faster. If it crosses apps or includes a clunky desktop program, Computer Use is the right tool.


    Step 2: Enable Computer Use Safely

    In the Cowork desktop app: Settings → Desktop app → Computer use → toggle on.

    macOS will prompt you for two permissions:

  • Screen Recording — so Claude can see what's on screen
  • Accessibility — so Claude can move the mouse and type
  • Grant both. (You can revoke any time in System Settings → Privacy & Security.)

    Before doing anything else, prep your environment:

  • Close unrelated apps and tabs
  • Use a dedicated browser profile if possible (Chrome supports multiple profiles — make a "Claude" profile that has only what Claude needs)
  • Keep only the target app or window visible
  • Disable notifications for the next 30 minutes (a popup mid-action confuses everything)

  • Step 3: Write the Task Like an SOP

    Computer Use does best with very specific instructions. A vague prompt gives vague behavior; a tight, step-by-step prompt gives accurate results.

    Always include:

  • The exact app or website (URL or app name)
  • The page or screen to start on
  • The exact button or menu labels Claude should look for
  • The loop logic — "for each row in this list, do these steps"
  • The batch size — "do 5 first, then stop and let me check"
  • What to do when unsure — "if a field doesn't exist on the form, leave it blank and add a note"
  • Treat it like writing an instruction manual, not a wish.

    Step 4: Job #1 — The Form-Fill Helper

    This is the highest-leverage Computer Use job for normal people. Visa forms, insurance, school registrations — all benefit.

    First, save your standard info to a Notion page (or a text file Claude can read). Things like full name, passport number, address, employer, etc.

    Open the form in your browser. Have Claude visible on the side. Paste:

    
    Fill in the form on the screen using my information from
    [Notion page name / file path].

    Rules:
    1. Read each field label carefully
    2. Match it to the equivalent field in my info
    3. If a field doesn't have a clear match, leave it blank and
    note it in a list called "questions for me"
    4. Do not click submit. Stop after the last field is filled.
    5. Take a screenshot of the completed form when done.

    Pause and ask me before any non-text action (dropdowns,
    checkboxes, file uploads). Let me confirm those manually.

    Claude will work field by field, taking screenshots, choosing values, asking when uncertain. You watch and approve. By the time it's done, the form is filled — you just review and click submit.


    Step 5: Job #2 — Multi-Site Price Comparison

    For big purchases (electronics, appliances, travel), Computer Use can do what's impossible by hand: visit 10 sites for the same product, log the price, and report.

    Make a small text file with your target product names and the URLs to check (one per line). Then in Claude:

    
    For each retailer URL in this list, do the following:

    1. Open the URL in a new tab
    2. Find the listing for [product name]
    3. Read the current price
    4. Note the shipping cost (if shown)
    5. Note the estimated delivery date
    6. Take a screenshot of the listing as proof
    7. Move to the next URL

    When done with all sites, give me a clean comparison table:

  • Site name

  • Total cost (price + shipping)

  • Delivery date

  • Link

  • Any flags (low stock, last item, "deal price ends soon")
  • Sort by total cost ascending.

    If a site requires login, skip it and note it in the report.
    If a price isn't visible without entering my postcode, use:
    [your postcode] and continue.

    This takes 5–10 minutes for 10 sites. The output saves you a manual round of opening tabs and writing prices on a Post-it.

    Step 6: Job #3 — Bulk Admin Upload

    For repetitive admin tasks in a legacy portal — uploading 50 receipts, registering 30 students, entering 100 inventory items — Computer Use shines.

    Make sure your data is in a clean spreadsheet first (one row per item, columns for each field).

    Then:

    
    The portal is open at [URL/screen]. I have a spreadsheet at
    [file path] with [N] rows of [data type] to upload.

    For each row in the spreadsheet:
    1. Click "New entry" (the orange button top right)
    2. Fill in the fields:
    - Name → column A
    - Date → column B (format: DD/MM/YYYY)
    - Amount → column C (numeric only, no commas)
    - Category → column D
    3. Click Save
    4. Wait for confirmation message ("Entry saved")
    5. Take a screenshot of the confirmation
    6. Move to next row

    Important: Process the FIRST ROW ONLY. Then stop, show me
    the screenshot, and wait for my "go" before continuing
    with the rest.

    If any row fails or behaves differently, stop and ask me.

    The "first row only, then stop" pattern is the safety net. If row 1 went perfectly, type "go" — Claude continues with rows 2 through N. If row 1 looked wrong, you stop now and adjust the prompt before letting it run on dozens of rows.


    Step 7: Safety Habits That Keep Things Sane

    Five habits to lock in:

  • Clean environment first. One window. No notifications. No distracting tabs.
  • First-item test. Always run the task on one item, supervise closely, then continue.
  • Stop before the irreversible action. Submit, send, delete, charge — don't let Claude do these without your final click.
  • Use sandboxed accounts when possible. A separate browser profile or test account on a portal limits the blast radius if something goes wrong.
  • Keep a "stop" hand on the keyboard. Ctrl+C in the Claude chat halts immediately. Mouse jiggle or clicking yourself also breaks Claude's flow safely.

  • Step 8: Computer Use's Real Limitations

    Be honest about what it's bad at:

  • Speed — it's slower than you would be on a job you do often. Worth it only when the task repeats or has lots of items.
  • CAPTCHA / anti-bot pages — Computer Use can't solve these. If you hit one, you take over manually.
  • Dynamic pages that change every visit — sites that re-shuffle their layout will trip Claude up. It works best on stable interfaces.
  • Anything truly judgment-heavy — Computer Use clicks well; it doesn't make business decisions. Use it for execution, not for choosing.
  • For one-off jobs you do once a year, just do it manually. For recurring jobs that take an hour each time, Computer Use earns back its setup cost on the second run.

    Going Further

    Turn a working flow into a saved automation. Once a Computer Use task runs cleanly, save the prompt as a Cowork shortcut (Article 11). Next month when you need it again, two clicks instead of rebuilding the prompt.

    Pair it with a calendar trigger. Some advanced setups (covered in the capstone, Article 18) let a Computer Use task fire automatically when a calendar event hits. Useful for monthly admin jobs you currently forget until they're overdue.

    Build a personal Computer Use playbook. Keep a Notion page called "automations" with each working prompt and what it does. Over months, you accumulate a library — the things you used to dread doing become 10-minute click-and-watch jobs.

    Key Takeaways

    Here's what you learned in this guide:

  • Computer Use = Claude with eyes, mouse, and keyboard. Best for cross-app or clunky-app tasks that repeat.
  • Clean the environment first. One window. No notifications. Dedicated browser profile if possible.
  • Write prompts like an SOP. Exact app, exact buttons, loop logic, batch size, "what if unsure".
  • First-item test, then go. The safest pattern for any multi-item task.
  • Never let it click the irreversible button. Always stop one step before submit/send/delete.
  • Speed isn't the point — repetition is. Use it for jobs that come up often, not one-off tasks.
  • The first time Claude finishes a job that used to take you 90 minutes — visa form, bulk admin upload, multi-site comparison — and your part was 5 minutes of supervising, you'll never go back to manual.

    Learn AI, after work

    Track your progress, earn XP, and unlock more free tutorials in the AfterWork Bytes app.

    Open this tutorial in the app