The expert test: how to identify high-value AI features for your product

By Madalina Turlea·
The expert test: how to identify high-value AI features for your product

Why most AI features fail and a framework to find the ones that won't

The main reason most teams fail to move past "beta" AI features is that they lack clarity on where AI can bring the most value for their users. AI promised to be this revolutionary technology that would empower products to achieve new levels of productivity and creativity. Yet most product teams have not yet started building with AI. Most PMs are still locked out of AI development, a few data scientists or engineers singlehandedly control the implementation. For those who have tried to bring AI to their product, they default to the pattern that the most visible AI products have established: the chatbot.

Somehow, in the last year, "AI feature" has become synonymous with "prompt-based chat box." I experienced this firsthand a few weeks ago.

The chat-box became the only option to adding AI in products

I was preparing a Product Thinking training session for a Fortune 500 company. I spent hours on the content, structure, and how to make the session interactive for an audience of engineering team leaders. I decided to create a collaborative workshop where I would apply my framework with students in real time.

After finalizing the topic, structure, and framework, I needed a collaboration board for both in-person and online participants. I turned to Miro, thinking it would be the most familiar tool for the exercise.

It had been a while since I'd used Miro. To my surprise, when I created a new board, there was a big chatbot in the middle of the empty canvas.

At this point it was past 9 PM. I was tired, with limited energy to spend drawing a beautiful workshop board from scratch. So as soon as I saw the chatbot, I thought: This is exactly the type of AI support I need.

Miro chatbit.png

My expectation: describe my workshop, the sections, the audience, what I'm trying to achieve, and have AI do the heavy lifting. Identify the right template. Adjust the copy with my context. Save me an hour of dragging boxes around.

What I got instead: a formatted text block based on my prompt. My own words, slightly reformatted. No board. No sticky notes. Not even a template suggestion.

Miro AI response.png

I had typed a long, detailed prompt to give enhanced context. And I got a highly disappointing result.

I closed Miro and went to FigJam to create my board, not because FigJam had a better AI feature for this, but because I was frustrated by the false promise.

The understanding problem

One quote that stayed with me on good product UX is: good UX is not about removing friction, it's about creating understanding in your product.

Behavioural analysis shows that even high-friction tasks, when user expectations are set properly, can lead to higher conversion rates. When you add AI to your product, you have to ensure you create the right understanding for what the AI can actually do.

When you give users an open-ended interaction like a chatbot, you cannot control what they type. You cannot guide their expectations. And when reality doesn't match expectations, frustration grows fast.

That's what happened with Miro. The chatbot created an expectation it couldn't fulfill.

Elena Verna, Head of Growth at Lovable (the AI company that hit $200M ARR in under a year), recently described a fundamental shift happening in product development:

"We're moving to a new era of software that needs to feel human — that people want to interact with, not just utility of it. Because cost of software is coming down so much to develop that we now can actually invest into emotional feel of that software."

This is the table stakes shift I keep coming back to: when building software becomes cheap, the differentiator moves from can we build it? to does it create understanding? Does it set the right expectations? Does it feel like magic or like work?

How the best products do it