The system automatically analyzes all training queries and assigns a certainty rating between 0% and 100%. Queries with certainty below 70% should generally be reviewed.
Understanding Certainty Ratings
- 70-100%: High confidence, likely correct
- Below 70%: Low confidence, manual review recommended
- The "Review Low Certainty" button appears when low-certainty queries exist
Walkthrough:
certainty-concept.mp4
Low Certainty Review Process
- Click "Review Low Certainty" to open the review modal
- For each low-certainty query, you'll see:
- The original prompt and query
- Certainty rating and analysis explaining the rating
- Available actions
Review Actions
- Delete: Remove the problematic query
- Edit: Manually correct the prompt or query
- Use AI Fix:
- If available: Click "View Fix" to see suggested corrections
- If not available: Click "Generate Fix" to request AI assistance
AI Fix Review
When viewing an AI-suggested fix, you'll see:
- Original prompt
- Original query with identified issues
- Suggested corrected query
- Explanation of improvements