Review Questionable Training Examples

How to review questionable training examples

The system automatically analyzes all training queries and assigns a certainty rating between 0% and 100%. Queries with certainty below 70% should generally be reviewed.

Understanding Certainty Ratings

• 70-100%: High confidence, likely correct

• Below 70%: Low confidence, manual review recommended

• The "Review Low Certainty" button appears when low-certainty queries exist

Low Certainty Review Process

1. Click "Review Low Certainty" to open the review modal

2. For each low-certainty query, you'll see:

   • The original prompt and query

   • Certainty rating and analysis explaining the rating

   • Available actions

Review Actions

• Delete: Remove the problematic query

• Edit: Manually correct the prompt or query

• Use AI Fix:

  • If available: Click "View Fix" to see suggested corrections

  • If not available: Click "Generate Fix" to request AI assistance

AI Fix Review

When viewing an AI-suggested fix, you'll see:

• Original prompt

• Original query with identified issues

• Suggested corrected query

• Explanation of improvements

• Option to accept or reject the fix