Getting started with AI evaluation

Start here if you're new to evaluating AI features. How to move past vibe checks, how to build your first test dataset from real user traffic, and how to get to a rubric your team actually agrees on — in a week, not a quarter.

Article30 AUG 2026

How to build an AI evaluation rubric from real outputs

A practical four-step method for building an AI evaluation rubric from real product failures: run, annotate, find patterns, and turn those patterns into checks.

Catalina Turlea

Article16 JUN 2026

How to move past vibe checks: scaling manual AI testing into systematic evaluation

Vibe checks are the right way to start testing AI — and the wrong way to keep going. The step-by-step path from a few happy-path tests to systematic, automated evaluation.

Madalina Turlea

Article16 JUN 2026

AI evals for product managers: the complete guide for 2026

The complete, practical guide to AI evals for product managers in 2026 — what an eval is, why it's a PM skill, and how to evaluate AI quality whether you have a live feature or just an idea.

Madalina Turlea

Article14 MAY 2026

What is AI experimentation, and why do you need it?

One idea. One prompt. Five real cases. Several models. Read every response. That's where AI-native products start. An 8-step playbook for product thinkers running their first experiment.

Madalina Turlea

Article15 JAN 2026

Using AI at scale is not the same as using ChatGPT

Using AI in a chat box is solving one problem. Building AI into a product is solving one problem many times — with the same instructions, for inputs you do not control.

Madalina Turlea

Article15 JAN 2026

Tokens, explained: what you are actually paying for when you build with LLMs

Tokens are the thing you pay for and the only number you can rely on. What a token actually is, why the same prompt costs different amounts across models, and the hidden reasoning tokens.

Madalina Turlea

Article15 JAN 2026

Why ChatGPT gets dumber the longer you talk to it

Long chats degrade for a concrete reason: the context window. The model is not remembering — it is being re-sent the whole conversation every turn, and there is a hard limit.

Madalina Turlea

Article15 JAN 2026

Does the AI know what day it is? Cutoff dates, web search, and why models differ

Models do not know the current date and stop knowing the world at their cutoff. What the cutoff is, why web search is expensive, and the three dimensions that actually make models different.

Madalina Turlea

Article15 JAN 2026

How to run an AI experiment, step by step

From idea to evaluation: how to write the first prompt, build realistic test cases, pick the right mix of models, review the answers side by side, and turn your notes into something you can scale.

Madalina Turlea

Article15 JAN 2026

How to build a test dataset for an AI feature

A good test set is the difference between a feature that looks fine in a quick check and one you can actually trust. How to replicate real usage, design inputs that try to break the feature, and grow the set as you learn.

Madalina Turlea

Article02 JAN 2026

Prompt Engineering Techniques: Part 1

Three foundational techniques that improve any AI interaction: writing specific instructions, providing context, and specifying the output format you actually want.

Maria-Fontica Marinescu

Masterclass24 OCT 2025

AI experimentation masterclass: personalised Airbnb description with AI

Your first AI experiment - a live walkthrough for PMs.

Catalina Turlea

← Back to all resources