Stop Using AI Just to Write Requirements. Use It to Challenge Them.

·

5–6 min read

For data and intelligence products especially, AI is most useful when it helps expose requirement gaps, edge cases, and assumptions before they become product problems.

AI can produce a polished requirements document in seconds. That’s useful. It’s also one of the least interesting things AI can do for a product manager.

The bigger opportunity is to use AI not just to create the artifact, but to challenge the thinking behind it.

A strong requirement isn’t simply well written. It has to account for ambiguity, missing rules, edge cases, unusual scenarios, conflicting assumptions, and the practical question of what actually matters enough to solve.

That is where AI can become much more valuable.

Instead of asking, “Can you write this requirement for me?” try asking: “Perform a gap analysis on this requirement.” “Identify where this could break.” “Surface the assumptions embedded in the logic.” “Identify edge cases that may not have been considered.” “Which of those edge cases are actually material?”

And sometimes, rather than asking AI to answer those questions at all, have it interview you.

That shift changes AI from a writing assistant into a thinking partner.

The examples here lean toward data and intelligence products, because distributions, sparse populations, missing data, and unusual combinations can turn a technically correct requirement into a misleading product outcome. But the same approach applies to workflow and platform products too.

A polished requirement can create false confidence

One risk with generative AI is that it can make incomplete thinking look complete.

Give a model a rough idea and it can quickly turn it into a document with sections, assumptions, acceptance criteria, and professional language. The result can look thorough. But formatting is not rigor.

A beautifully written requirement can still hide an undefined business rule, assume data will always be present when it won’t, or miss a population that behaves differently. In some ways, AI-generated requirements make this more dangerous because the document can look finished before the thinking is finished.

That’s why AI becomes more valuable when it is used to poke holes in the requirement instead of simply polishing it.

1. Start with requirement gap analysis

A practical starting point is simple: give the agent a draft requirement and ask it to perform a structured gap analysis.

Ask it to look for ambiguous terms, undefined business rules, missing states, conflicting conditions, hidden assumptions, dependencies that aren’t addressed, acceptance criteria that aren’t testable, and places where expected behavior is unclear.

The output shouldn’t be treated as truth. Treat it as a list of questions.

The goal isn’t to let AI decide what the product should do. It’s to make sure enough of the right questions have been asked before engineering starts.

For a data product, that might mean questions like: What happens when a source field is missing? Should incomplete records be excluded or treated differently? What if data arrives late? How are duplicates handled? Does historical data follow the same rule? What happens when several exceptions occur at once?

2. Let the agent interview you

A particularly useful pattern is to ask the AI to interview the product manager instead of asking it for an answer.

For example: “Act as a skeptical product reviewer. Ask the questions you need answered before this is ready for engineering.” Or: “Interview me until there are no material ambiguities left.”

This often works better than getting a static list of 30 observations.

The agent may ask what should happen when a value is missing. You answer. It then asks whether excluding those records could shift the denominator enough to make the result misleading. You answer again. Then it asks when that difference becomes material enough to warn the user.

Now the conversation has moved beyond requirement writing. It is forcing the product logic into the open.

The point isn’t to let AI do the thinking. It’s to make the thinking harder to shortcut.

3. Use AI to search for edge cases

Humans are naturally good at thinking through the scenarios they expect. They’re less consistent at exploring the long tail.

AI is very good at asking, “Okay, but what if...?”

For workflow products, that could mean unusual permission combinations, interrupted workflows, unexpected status transitions, or actions performed out of sequence. For data products, it may mean missing values, sparse populations, outliers, delayed data, skewed distributions, historical inconsistencies, or unusual combinations of filters and conditions.

The value here is breadth. AI can explore far more possible scenarios than a team can reasonably brainstorm in one meeting.

But that creates the next problem: AI can find a lot of edge cases. That doesn’t mean the team should build for all of them.

4. Size the edge case before you solve it

An edge case isn’t important just because it exists.

If AI identifies 40 possible exceptions, engineering should not automatically address all 40. Some may affect an extremely small number of records. Some may have negligible downstream impact. Some may add a lot of complexity for very little value.

Others may be rare but still matter a great deal. A scenario affecting 1% of a population could be important if it represents high-value customers, financial exposure, compliance risk, a clinically important group, or a situation where a wrong result would damage trust.

So edge-case analysis works best as a two-step process: identify it, then size it.

A simple way to think about it is frequency, impact, detectability, and cost to address. How often does it happen? What happens when it does? Will anyone know? And how much complexity is added to solve it?

That changes the question from “Does this edge case exist?” to “Is this edge case important enough to change what we build?”

AI can help structure that analysis. The product team still has to make the call.

5. Stress the assumptions, not just the requirement

Requirements are usually written around an expected world. Products rarely operate in one.

For data and intelligence products in particular, AI can be useful for what-if analysis. What if the population doubles? What if one segment becomes most of the data? What if a key field becomes sparse? What if the distribution becomes heavily skewed? What if definitions change over time? What if two rare conditions happen together?

A calculation can be technically correct and still produce a misleading result under a different distribution or population. That’s the kind of problem that can be hard to see if only the happy path is tested.

AI doesn’t replace statistical analysis, domain expertise, or QA here. It expands the search space so the team can decide what deserves a closer look.

6. Turn the useful findings into tests

Once real gaps and meaningful edge cases have been identified, AI can help turn them into test scenarios: happy paths, negative cases, boundary conditions, missing-data scenarios, distribution changes, conflicting rules, and combinations of unusual conditions.

That creates a useful bridge between product thinking and quality. QA is no longer something that starts after development. Quality thinking starts while the product is still being defined.

AI provides breadth. Humans provide judgment.

There’s a lot of discussion about how much product-management work AI will automate. That may not be the most interesting question.

The better question is: How can AI improve the quality of the decisions we make before we build?

AI is excellent at breadth. It can tirelessly examine assumptions, generate scenarios, ask questions, identify gaps, and explore the long tail.

Humans are still responsible for judgment: Which customer matters? Which scenario is material? What risk is acceptable? What complexity is justified? When is an edge case too small to solve? When is a rare scenario too important to ignore?

Those are product decisions.

So yes, use AI to make requirements faster. But don’t stop there.

Use it to make the thinking better.

Use AI for breadth. Use humans for judgment.