Cassie Kozyrkov

Former Chief Decision Scientist at Google. Expert on AI decision-making and practical ML applications.

Filter by Source

3 tips total

Topics

AI Agents (1) Enterprise AI (3)

All Tips

How should I evaluate AI outputs in my organization?

Create a rubric before deploying. Define what "good" looks like with specific criteria: accuracy, tone, completeness, safety. Have humans rate a sample of outputs weekly. Track trends over time. Don't just measure speed—measure quality.

moderate Cassie Kozyrkov Enterprise AI

What are the key risks of enterprise AI deployment?

Three main risks: data leakage (sensitive info in prompts going to third parties), hallucination liability (AI confidently stating false information), and shadow AI (employees using unapproved tools). Address each with policies, not just technology.

moderate Cassie Kozyrkov Enterprise AI

How do I handle AI hallucinations in production?

Layer defenses: ask the model to cite sources, implement fact-checking against known databases, flag low-confidence responses for human review, and set clear expectations with users that AI can make mistakes. Never fully automate high-stakes decisions.

advanced Cassie Kozyrkov Enterprise AI, AI Agents