Public reading view · SmartAItomation

Video scripts & schedule

Short educational videos about AI evals, agents and RAG. Each draft teaches one concrete lesson. Scripts and schedules are for review and manual posting.

The three initial scripts come from your video review; examples and scores are illustrative. Guide delivery is manual and is not configured automatically.

Unlock editing on this device to schedule, mark done or comment.

0/35marked done

Scores are your own editorial ratings, not predicted performance. New drafts have no score.

Video 1 · Review draft · hypothetical example · not recorded

Ask before recommending a laptop

Hook: A shopping agent recommends a laptop before learning the customer’s budget or intended use. In this example, I’ll show you a tempting fix, why it fails, and the expert workflow we can test instead.

UnscoredPlanned
Show scriptHide script
A shopping agent recommends a laptop before learning the customer’s budget or intended use. In this example, I’ll show you a tempting fix, why it fails, and the expert workflow we can test instead. The obvious fix is to instruct the agent: “Always ask about budget and intended use.” That catches missing details, but only if the customer hasn’t already given them. Now a customer says, “I need a laptop for school, under 800 dollars.” The agent asks for the budget and use again. It has the information, but ignores it. A sales expert gives the team a better workflow: first identify what the customer has already said. Ask about important missing requirements only when they could change the recommendation. Then explain why the option fits and any relevant trade-offs. The team turns that workflow into eval cases. In one conversation, the customer says only, “I need a laptop,” so the expected next step is to clarify budget and use. In another, both are already given, so the agent should use them without repeating the questions. An expert labels the expected behavior and reviews the agent’s full conversations. Then engineers rerun separate cases after a change: does it clarify real gaps, use known details and recommend something suitable? Coaching engineers to turn expert workflows into evals gives them a way to catch these failures in production—and reuse the process for their next AI product.
Unlock scheduling & Done

Hook details

Video 2 · Review draft · hypothetical example · not recorded

Ask enough questions—not ten

Hook: A shopping agent asks ten questions before recommending one product. I’ll show you why limiting questions alone can fail, and how to test a better expert-defined workflow.

UnscoredPlanned
Show scriptHide script
A shopping agent asks ten questions before recommending one product. I’ll show you why limiting questions alone can fail, and how to test a better expert-defined workflow. The first fix sounds simple: tell the agent to ask no more than two questions. That reduces the count. But it doesn’t guarantee they’re the right questions. Imagine a student already gave a budget and said the laptop must fit in a backpack. The agent uses its two questions to ask for those details again, then recommends a laptop without checking required software. In this example, that software determines which laptop will work. So we try another instruction: “Don’t repeat questions.” Better—but the agent can still skip an essential question. Avoiding repetition is only part of the job. A sales expert defines the full workflow: use what the customer already said, identify missing details that could change the choice, and clarify important gaps or conflicts. When there’s enough information, recommend a suitable product and explain the trade-offs. The team builds eval conversations around that workflow. If the customer gave everything needed, proceed without repeated questions. If required software is missing, ask. If requirements conflict, clarify before choosing. An expert labels examples, and engineers review the full conversation on separate cases after each change. That shows both unnecessary questions and missed requirements. Coach your engineers to build these evals with experts. They can use the same method on the next AI product too.
Unlock scheduling & Done

Hook details