ET.
All writing

AI prototyping · Draft for review

Why Prototyping Matters More When the Technology Is Uncertain

When teams cannot predict behavior from requirements alone, a working prototype becomes a tool for product, technical, and organizational learning.

July 10, 20264 min readElisha Terada

Teams often treat a prototype as a faster way to show an idea.

That is useful, but it understates the role prototyping plays when the technology itself is uncertain.

With an AI product, the team may not yet know whether available data is sufficient, whether the behavior will remain useful across real cases, whether users will trust it, or whether review and recovery will make the workflow too expensive.

A requirements document can describe what everyone hopes will happen. A working prototype creates a place to discover what actually happens.

Some questions cannot be resolved on paper

Planning is valuable when the team understands the system well enough to predict it.

Uncertain technology weakens that prediction. The same instruction may produce different results across cases. A model that performs well with curated examples may struggle with organizational data. A behavior that sounds helpful may feel intrusive or difficult to review when placed in a real workflow.

The team can debate these possibilities for weeks. At some point, more detail in the plan creates the appearance of certainty without increasing understanding.

A prototype turns the argument into an observation.

Interaction reveals the real product

Many important AI decisions appear only when someone uses the system.

How should a user express intent? Should the product show one answer or several options? What evidence does the person need before acting? When should the system ask a follow-up question? How should correction work? What happens to unfinished work when the model fails?

These are difficult to understand through a static screen because the product is defined by behavior over time.

A working prototype lets the team experience that behavior. It makes invisible assumptions available for discussion.

Technical learning and product learning belong together

Technical spikes often ask whether a model, data source, or integration can work. Product prototypes ask whether the experience helps a user.

For uncertain technology, separating those questions too cleanly can create false confidence.

A model may retrieve the correct document while presenting the result in a way nobody trusts. A workflow may delight users but depend on data the organization cannot access reliably. An automated action may be technically feasible while creating an unacceptable ownership problem.

The prototype should connect enough of the system to expose these dependencies early.

When the parts of a product are uncertain together, they need to be learned together.

Fidelity should follow the risk

Not every part of the prototype needs to look or behave like production.

Choose fidelity based on what the team needs to learn.

If the risk is whether users understand the workflow, the interface and transitions may need to feel real while the AI behavior is partly simulated. If the risk is retrieval quality, the prototype needs representative data more than visual polish. If the risk is trust, the sources, review, correction, and failure states deserve attention.

This prevents the team from spending time perfecting parts of the experience that do not affect the current decision.

A prototype should make uncertainty smaller

The output of a prototype is not only the artifact.

It is a clearer view of the opportunity:

  • Which use cases produce meaningful value?
  • Which behavior can users understand and control?
  • Which data or operating constraints matter most?
  • Which risks can be designed around?
  • What should the next investment prove?

A successful prototype may support the original direction. It may also narrow it, change it, or show that the organization should not proceed.

All of those outcomes can be valuable if they arrive before a large build commitment.

Build to learn before building to scale

Uncertainty is not a reason to avoid action. It is a reason to choose a different kind of action.

Instead of asking the first build to carry the weight of a production roadmap, give it a focused learning goal. Put realistic users, data, and consequences into the experience. Observe what changes. Record the decisions the evidence supports and the questions that remain.

When technology is predictable, a prototype helps people see the future product.

When technology is uncertain, it helps the team decide whether that future product should exist—and what it would need to become useful.