BookbagBookbag
Glossary

Needs Fix

A verdict in the AI QA & Evaluation Platform indicating that an AI-generated message has quality or compliance issues that a QA reviewer can correct before the message is approved for delivery.

What It Means

Key Insight

needs_fix is where the magic happens — every correction is simultaneously a quality save AND a training data point that makes the AI smarter.

needs_fix is the middle verdict — the message isn't clean enough to ship, but it's not bad enough to block. It has fixable issues: a tone that's too aggressive, a claim that's slightly off, personalization that missed the mark, compliance language that needs tightening. The message routes to a QA reviewer who sees exactly what was flagged, makes the correction, and approves the fixed version. Here's the key insight: that correction is doing double duty. The fixed message goes to the recipient. And the pair — original (bad) plus correction (good) — becomes training data you can export to make your AI better. Every needs_fix item is both a quality save and an investment in future quality.

Why It Matters

The needs_fix lane is the most valuable part of the entire AI QA & Evaluation Platform. Safe messages are great but teach you nothing. Blocked messages are rare. needs_fix is where you find the patterns — the recurring tone issues, the systematic hallucinations, the compliance gaps your AI keeps hitting. Fix the message, capture the correction, export the training data, retrain the model. That's how safe_to_deploy rates climb from 60% to 85%.

How Bookbag Helps

Contextual QA interface

Reviewers see the flagged issues, rubric citations, and original message side-by-side. No guessing about what needs fixing or why.

Automatic training data structuring

Every correction is automatically formatted as SFT and DPO pairs — ready to export for model fine-tuning without additional processing.

Pattern detection

Aggregate needs_fix data reveals systematic AI weaknesses — recurring tone issues, common hallucination types, persistent compliance gaps — so you can fix root causes.

Frequently Asked Questions

Related Resources

See how Bookbag works

Join the teams shipping safer AI with real-time evaluation, audit trails, and continuous improvement.