What is AI user testing, and how does Menso run it?

AI user testing sends an AI agent with a persona and a task through your real website, to see whether a person like that would finish and where they would get stuck. Menso runs the agent in a cloud browser on your live site. It looks at each screen, clicks, types and thinks aloud until it finishes, gets blocked or runs out of steps. You get a replay of every step, with what it was thinking, and a TRACES score out of 100. A Speed test costs 40 credits; new accounts start with 100 free. It predicts likely friction early. It does not replace real users.

Last updated

What happens in a Menso test

  1. You give it an address and a task. Paste your product's URL and pick a template: Purchase intent, Sign up & log in, or With materials. Or start from the address alone, and Menso researches the product and writes a persona and a task for it first (10 credits).
  2. An AI user works through the task. It gets its own browser session on your live site. At each step it looks at the screen, decides what to do, acts, and says what it expected and what happened. It can sign up or log in with an email and password you give it. Saved logins are stored on Menso's server and used by Menso's cloud browser to run the tests you ask for. The web app shows a saved login's email or username, never its password. The desktop app can't use saved cloud logins for now.
  3. The run ends at a result. It stops when the task is done, when the product blocks it, or when its step budget runs out (the Product Hunt board run below had 16 steps). If a run fails because of Menso, the credits go back to your balance automatically.
  4. You read the evidence. The replay shows every step with the AI user's think-aloud. The TRACES score sums the run up in six dimensions, each with a written reason.

What you get back

  • A replay of every step: what the AI user saw, did and thought. Every plan.
  • A TRACES score from 0 to 100 across six dimensions, each with its reason. Every plan. How the score works.
  • A share link for a replay, for your team or a client, once Menso has checked that it shows none of your logins or secrets. Pro and Studio.
  • A full UX report on every run, with PDF export. Studio.

Speed or Quality?

Both run the same task on your live site. A Speed test (40 credits) is the quick, low-cost check. A Quality test (300 credits) gives the AI user more time to think at each step. Every run on the Product Hunt board is a Quality test.

What it costs

Pro: one Speed test ≈ $0.64, one Quality ≈ $4.83 at $29 / 1,800 credits, plus 10 credits (≈ $0.16) of research when you start from just a URL; Free 100 credits = 2 Speed tests, no card.

  • Free: 100 credits when you create an account and 20 more each day you sign in.
  • Pro: $29 a month for 1,800 credits, plus replay sharing.
  • Studio: $69 a month for 6,000 credits, plus a full UX report on every run.
  • Credit packs: 300 for $9.99, 1,000 for $19.99.

Every plan and pack is on the pricing page.

A real run, as it happened

Menso puts the top launches from Product Hunt's weekly board through one shared task. Here is one of them; the full board has the rest of its week.

Every run here used Menso's Purchase intent template: the persona Zainab Salazar, a freelance UX consultant, reads the homepage, the pricing page and the FAQ, decides whether she would buy or sign up, and stops before paying. It is a route-specific diagnostic, not a product-wide score.

tiun.

TRACES 83.5/100

Product Hunt week 38 (Sep 14 – 20, 2026), #2 on Product Hunt's board · tested Sep 21, 2026 · one AI user, one run (n=1) · Quality test · 16 of 16 steps · tiun.io

Zainab scrolled the homepage for five steps without finding a pricing link, and at step 6 typed the pricing address herself. At step 8 she reached the Free vs Enterprise table, then read the help centre and the docs FAQ, and at step 16 decided to sign up for the free tier.

T 4 · R 4.5 · A 4 · C 4 · E 4.5 · S 4 (each out of 5)

Review note: The actor never opened the top-right menu, where Pricing sits; this is not a claim that the site has no pricing link.

Made one of these products? Write to support@menso.io and we will correct or remove the example as soon as we can.

What it cannot tell you

  • One AI user, one route, one run. The result describes that route, not your whole product, and a different persona or task can go differently.
  • An AI user is not your customer. It has no money at stake and no history with your product. Studies of AI-simulated users in conversation tasks report that they can miss friction people feel and make results look more optimistic (Liu et al., Yoon et al.).
  • It has no inbox or phone of its own. When a signup or login sends a verification email, the run pauses and asks you to paste the code or link, and waits up to two hours. A phone or SMS code ends the run.
  • It is not an accessibility audit. The board run cited on this page used no keyboard navigation and no screen reader.

Use it to find likely friction before real users arrive, and to decide where your research with people should go next.

Questions people ask

Is AI user testing the same as synthetic user research?

Not quite. Synthetic research tools ask an AI persona interview questions and read its answers. An AI user test puts the persona in front of your actual product and records what it does. Menso does the second. Both are simulations, and neither replaces talking to your customers. The comparison of AI usability testing tools sets out the difference.

Can I run a usability test without recruiting participants?

Yes. That is what an AI user test is for: no panel, no scheduling, no incentives. You get a stranger's first pass through your flow in one run. You do not get a real person's motives or stakes, so use the result to decide where to look, then confirm the findings that matter with people.

Does Menso need my code or a tracking snippet?

No. The AI user visits your live site the way a visitor does, in its own browser session. For pages behind a login, give it an email and password on the credentials card. On the web app it signs in with email and password only; Google sign-in on your product works only in the Menso desktop app.

How much does AI user testing cost with Menso?

Pro: one Speed test ≈ $0.64, one Quality ≈ $4.83 at $29 / 1,800 credits, plus 10 credits (≈ $0.16) of research when you start from just a URL; Free 100 credits = 2 Speed tests, no card. See pricing for every plan.

Can I share a result with my team or a client?

On Pro and Studio, you can make a share link for a replay. It opens without signing in, like the Product Hunt board replay on this page. Menso first checks the replay for the logins and secrets you gave it, and makes no link if it finds one or cannot run the check. Studio also writes a full UX report on every run and exports it as a PDF.