The Automated tab leverages AI to generate synthetic training examples, accelerating the training process while maintaining quality through review mechanisms.

Generation Methods

1. Quick Generation (Synchronous)

• Click the "Generate" button to instantly create up to 10 prompt/query pairs

  

• Generated examples are created in "pending" status, requiring manual review

• Best for: Quick testing or when you need a few examples immediately

• Trade-off: Uses faster but lower-quality models due to speed requirements

Walkthrough:

automated-generation.mp4

2. Configured Generation (Asynchronous) - Recommended

Configure ongoing generation of synthetic queries:

• Quantity: Specify how many synthetic queries to generate in total
  • This number includes existing rows. If you have 5 rows already and set the
• Auto-approval: Choose whether queries should be:
  • Automatically approved and used immediately
  • Held in "pending" status for manual review

Configuration Options

When setting up automated generation, consider:

• Volume: Start with smaller batches (between 5 and 20) to assess quality
• Review requirements: Initially, either enable manual review or set a high minimum certainty (between 80% and 95%) to ensure the quality of generated examples
• Iteration: Adjust configuration based on the quality of generated examples

Why asynchronous is preferred: