Reviewing Pending Queries

How to review and approve synthetic training examples

Depending on your configuration (see Creating Automated Training Data), automated training data may be placed in "pending" status, requiring manual review in order for the Alkemi Agent to start using it. If there are any queries in “pending” status, you'll see a "Review Pending Queries" button.

Individual Review

1. Click "Review Pending Queries" to open the review modal

2. For each query, you can:

   • Accept: Approve the prompt/query pair as-is

   • Edit: Modify the prompt or query before saving

   • Delete: Remove the training example entirely

Batch Review

1. Select queries using checkboxes in the table

2. Choose to either:

   • Accept: Approve selected queries for training

   • Delete: Remove unsuitable queries