AI implementation

How to evaluate an AI product idea before you build it

A convincing demo is not the same as a viable product. Use this guide to pressure-test an AI product idea before time and build cost climb.

Nick Lawton9 min read

A strong AI product idea survives contact with delivery cost, workflow reality, and customer value, not just a good demo. The real test is whether there is a repeated problem, a user willing to change behaviour, and economics strong enough to justify building around it.

Separate a model demo from a product worth buying

The first trap is confusing a model capability with a commercial product. A model might summarise, classify, recommend, or generate something impressive in a demo, but that does not mean there is a painful enough workflow, strong enough buying need, or reliable enough outcome to support a real product decision.

Founders should start by asking whether the user problem is painful without the words 'AI' attached to it. If the pain is weak, the capability novelty will not save it for long.

Test whether the workflow pain is real, repeated, and expensive

The strongest AI product ideas sit inside repeated workflows where time, cost, inconsistency, or cognitive load are already causing pain. If the problem happens only occasionally, or if customers are not actively trying to solve it now, the product risk rises quickly.

  • How does the problem occur for the target user?
  • What are they doing manually today to cope with it?
  • Is the current workaround expensive, slow, or error-prone enough to matter?
  • Would they pay, switch, or change behaviour if this got better?

A founder-friendly idea screen

You do not need a giant innovation framework to test the idea properly. You do need a few blunt questions that stop the team falling in love with the capability before the operating reality is clear.

  • Is the problem valuable enough without the AI story attached?
  • Can we access the data or inputs the workflow actually needs?
  • Will a user trust the output enough to use it in a live workflow?
  • Can we set a review, fallback, or confidence threshold where needed?
  • Does the economics still work once the model, monitoring, and support cost are included?
  • Is there a narrower pilot version that proves the hardest assumption first?

Pilot the hardest assumption before building the platform

The best next step is not a full product build. It is a pilot that tests the hardest assumption: user demand, workflow fit, model quality, economics, or trust. That gives the business much better evidence before engineering effort, platform decisions, and commercial promises get heavier.

  • Name the hardest assumption first
  • Design the smallest pilot that can test it credibly
  • Keep the workflow narrow enough to measure honestly
  • Only widen the build plan once the evidence improves

Questions and discussion

Have a question about this, or an experience to add? Ask me below. Please leave out anything confidential.

No questions yet. What would you like to know?

Ask me a question

Got a question, a different result or a mistake I should look at? I’d like to hear it.

Shown publicly with your approved question.

Kept private. We will email you a confirmation link.

Please leave out client names, credentials and private project details.

Once you confirm your email, I’ll read your message before it appears here. You won’t be added to a marketing list. Read our privacy notice.

Our discussion guidelines
  • Ask a question, challenge a finding or share what worked for you. You don’t have to agree with me.
  • Keep it relevant and respectful. Advertising, harassment and repeated spam will not be published.
  • Do not share personal information about others, private client work, access details or confidential material.
  • Nick approves every reader contribution. An email confirmation checks that you control the address, not your identity.

Manage your questions and reply emails.

Keep reading.

Use an RSS reader? Add this feed and my new posts will appear there. No extra account needed.

Get the RSS feed