Lovelaice · Author
Madalina Turlea
Co-founder & CPO, Lovelaice
Product leader from regulated fintech — 10+ years shipping software people can stand behind.
Madalina is co-founder and Chief Product Officer at Lovelaice. She brings more than ten years of product experience from fintech, payments, and compliance — environments where you can't ship something just because the demo looks right. Before Lovelaice she led AI product development inside a highly regulated fintech, watching first-hand how teams struggled to evaluate AI features against the standards their industries demand.
She is a CFA charterholder, which informs how she thinks about model risk, calibration, and the costs of being wrong at scale. At Lovelaice she leads the product practice, owns the customer relationship for early design partners, and shapes how product managers — not just engineers — can drive AI quality.
Madalina teaches product managers on Maven, co-leading two cohorts with Catalina: "Build AI Features for Confident Product Managers" and "AI Evals for Product Managers". She writes here about the workflows product teams need when domain experts, not data scientists, are the people who actually know whether the AI is working.
Background & credentials
- CFA Charterholder
- 10+ years in fintech, payments, and compliance product
- Former AI product lead in regulated fintech
- Maven instructor — Build AI Features for Confident PMs & AI Evals for PMs
Published by Madalina
Article
The battle of the LLM judges: Which LLM judge can you trust with your AI product's quality?
Lovelaice's custom judge built from human annotations hit 76% and swept the top 8 of 80 pairings. Seven generic templates averaged a coin flip.
Article
How to move past vibe checks: scaling manual AI testing into systematic evaluation
Vibe checks are the right way to start testing AI — and the wrong way to keep going. The step-by-step path from a few happy-path tests to systematic, automated evaluation.
Article
AI evals for product managers: the complete guide for 2026
The complete, practical guide to AI evals for product managers in 2026 — what an eval is, why it's a PM skill, and how to evaluate AI quality whether you have a live feature or just an idea.
Article
How to measure AI feature ROI (when half of teams can't)
Half of product teams name unclear ROI as their #1 AI challenge, and a third track no AI metrics at all. Here's a measurable framework for the return on a single AI feature.
Article
Why AI features fail: the silent failure problem
Only 7.8% of teams say their shipped AI features delivered measurable impact. Why AI features fail silently, why teams don't notice, and how to catch it before users leave.
Article
Who should own AI features in product teams?
AI defaulted to engineering, but the judgment layer where domain expertise lives is where AI features are won or lost. Who should own AI in product, and why the ownership has to move.
Article
What is AI experimentation, and why do you need it?
One idea. One prompt. Five real cases. Several models. Read every response. That's where AI-native products start. An 8-step playbook for product thinkers running their first experiment.
Newsletter
Why ship and learn just does not work for AI features
Why the traditional 'ship and learn' approach fails for AI features.
Newsletter
The death of the prompt box: what A16Z's 2026 prediction means for your AI features
What A16Z's 2026 Prediction Means for Your AI Features.
Article
Should you still write PRDs when building AI features?
The programming language is plain English. The prompt IS the spec, so why is the PM three handoffs away? Why "evals are the new PRDs" makes things worse, and what PM-owned AI development actually looks like.
Newsletter
Lessons from one year of AI product building
Key insights from building AI products over the past year.
Newsletter
The expert test: how to identify high-value AI features for your product
How to identify which AI features will deliver the most value.
Newsletter
Why your AI evaluation is lying to you
Why most teams automate AI evaluation before understanding what they're evaluating — and the step-by-step approach that actually works.
Article
Why 90% survey satisfaction and 40% churn can coexist
Your AI feature scores high on satisfaction surveys but users keep leaving. Here's why silent AI failures hide behind good survey numbers.
Article
Your AI always returns an answer. That's why you can't trust it.
AI features never throw errors — they just quietly get things wrong. Here's how product managers catch silent failures before users lose trust.
Article
What thumbs up/down feedback actually tells you about your AI feature
Thumbs up/down feedback on AI features measures user sentiment, not output quality. Learn what binary feedback misses and what to measure instead.
Article
The silent failure loop: how you lose users without a single complaint
AI features don't fail loudly. They fail silently — and users leave before you notice. Here's how product teams break the loop.
Article
Why shipping a mediocre AI feature is worse than shipping nothing
A mediocre AI feature doesn't just underperform — it erodes trust, trains users to ignore you, and poisons every AI feature you ship next.
Article
What does "the AI is working" actually mean?
Most product teams can't define what 'working' means for their AI feature. Here's the definition that separates shipping with confidence from Ship and Pray.
Article
Using AI at scale is not the same as using ChatGPT
Using AI in a chat box is solving one problem. Building AI into a product is solving one problem many times — with the same instructions, for inputs you do not control.
Article
The model selection blind spot: why the newest model is not always the best
Teams default to the newest model before checking whether it fits the task. Frontier models do not win every time — and accuracy, cost, and latency rarely peak in the same place.
Article
AI always returns something, and that is the problem
AI never fails completely — it just returns plausible answers, sometimes wrong. Why ship-and-hope traps teams, and what real iteration on a prompt actually looks like.
Article
Why AI features should not be owned by engineering alone
Engineers build the technical part. Domain experts hold the context that makes AI intelligent. Why prompt and evaluation work belongs with the people who understand the problem.
Article
We tested the viral prompt tricks. Most of them do nothing.
Threatening the model, all caps, high-stakes framing — we ran the viral prompt techniques across nine models on real extraction tasks. Structure and clarity beat hacks every time.
Article
Markdown, XML, or JSON: how to format a prompt so the model understands it
The format you put your prompt in changes accuracy more than you would expect. When to use Markdown, when to reach for XML tags, and when JSON is the right tool.
Article
When to use RAG instead of putting the whole document in the prompt
Putting the whole policy in the prompt works — until you have many policies or one that has grown too big. The simple rule for when to switch to RAG, and the cost reason underneath it.
Article
Tokens, explained: what you are actually paying for when you build with LLMs
Tokens are the thing you pay for and the only number you can rely on. What a token actually is, why the same prompt costs different amounts across models, and the hidden reasoning tokens.
Article
Temperature, max tokens, and streaming: the LLM settings that quietly change your output
The API parameters you send with every prompt change how the model behaves. What temperature, max tokens, top-P, reasoning settings, and streaming actually do — and when they matter.
Article
Why ChatGPT gets dumber the longer you talk to it
Long chats degrade for a concrete reason: the context window. The model is not remembering — it is being re-sent the whole conversation every turn, and there is a hard limit.
Article
Does the AI know what day it is? Cutoff dates, web search, and why models differ
Models do not know the current date and stop knowing the world at their cutoff. What the cutoff is, why web search is expensive, and the three dimensions that actually make models different.
Article
LLM-as-a-judge: how to evaluate AI features without checking every answer by hand
Most teams build the wrong judge — vague rubrics, one-to-five scoring, no validation. The three-stage evaluation ladder, why a judge should be binary and single-error, and how one prompt went from 50% to 93% agreement with humans.
Article
Error analysis for AI: turning messy review notes into a fix list
You cannot improve an AI feature until you know how it actually fails — not how you think it fails. The unglamorous front end of every reliable AI feature: read, annotate, group by root cause.
Article
Building an expense-policy AI agent: what we learned reverse-engineering Ramp
Three prompts, six models, 126 runs. What we learned trying to reverse-engineer Ramp's expense-policy AI agent — including why a more detailed prompt actually made GPT-5 worse.
Article
How to run an AI experiment, step by step
From idea to evaluation: how to write the first prompt, build realistic test cases, pick the right mix of models, review the answers side by side, and turn your notes into something you can scale.
Article
How to build a test dataset for an AI feature
A good test set is the difference between a feature that looks fine in a quick check and one you can actually trust. How to replicate real usage, design inputs that try to break the feature, and grow the set as you learn.
Article
Start with the prompt, not RAG: giving an AI feature access to your knowledge
The instinct is to reach for RAG. The advice that works is the opposite: start by stuffing the important knowledge into the prompt, and only add complexity when the volume actually demands it.
Article
Deterministic metrics: automating the checks you would otherwise do by hand
Small pieces of code that run on every answer and check for something specific — length, format, language, JSON schema, expected items. How metrics measure (not enforce) and connect back to error analysis.
Article
Infinite personalization without the AI slop
AI lets you personalize content infinitely — and slip into generic slop just as easily. The two failure modes to watch for, and why feeding the model your real data is the difference between insight and filler.
Course ↗
Ship AI features with confidence for PMs
Course on shipping AI features with confidence for product managers.
Masterclass ↗
Reverse-engineering AI products: from system prompts to cost
Let's look at some of the most popular AI products and their estimated AI cost.
Masterclass ↗
Myth busters edition - prompting techniques
Let's test out some popular beliefs about prompting AI.
Masterclass ↗
Demystify popular AI features with us - part 1
Breaking down how popular AI features work under the hood.
Masterclass ↗
Personalised activation emails with AI
Live workshop on building AI-powered personalised activation emails.
Masterclass ↗
Personalization demo for Airbnb AI product feature
A demo of AI experimentation for personalisation features.
Masterclass ↗
Test an AI feature with us - implement Linear's AI Slack feature
Live walkthrough implementing Linear's AI Slack feature.
Masterclass ↗
AI experimentation masterclass: personalised Airbnb description with AI
Your first AI experiment - a live walkthrough for PMs.
Article
3 mistakes that make your AI feature a silent churn machine
Most AI features don't fail loudly. They quietly underperform while users quietly leave. Here are the three mistakes driving silent churn.
Article
The 4 most expensive AI evaluation mistakes (and the tender that died)
Four AI evaluation mistakes that cost product teams real money — from blown model selection to a million-euro tender lost to silent failures.
Article
3 mistakes PMs make when they let engineers own the AI prompt
Engineers build infrastructure. Domain experts build quality. Here are three costly mistakes that happen when PMs hand prompt ownership to engineering.
Article
5 AI testing mistakes that will cost you under the EU AI Act
The EU AI Act demands documentation, traceability, and risk management. Most product teams are still shipping AI on vibes. Here are five mistakes to fix now.
Article
3 model selection mistakes that are quietly burning your AI budget
Most teams pick their AI model on reputation, not data. Here are three model selection mistakes silently inflating your costs — and how to fix them.
Article
4 mistakes that turn a mediocre AI feature into a user trust killer
Most AI features don't fail loudly. They quietly erode trust. Here are four mistakes product teams make that turn mediocre AI into a reason users leave.
Article
The 3 prompt testing mistakes most teams don't know they're making
Most teams test prompts wrong without realizing it. Here are three specific mistakes that silently kill AI feature quality — and how to fix each one.
Article
5 mistakes product teams make when shipping AI features
Product teams keep making the same five AI shipping mistakes. Here's what they are, what they cost, and how to fix each one before users find out.