Overview
Each ring uses a pair of LLM prompts (system + user) for each of the three scenario fields: user_perspective, expected_outcome, and user_intent. You can customize these prompts to change how scenarios are generated for specific rings.
Prompt structure
Each ring has 6 prompt fields:
| Field | Description |
|---|
| User Perspective System | System prompt for generating the caller’s behavior description |
| User Perspective User | User prompt (includes placeholders for path, context, etc.) |
| Expected Outcome System | System prompt for generating expected agent behavior |
| Expected Outcome User | User prompt (includes generated user perspective) |
| User Intent System | System prompt for generating caller intent |
| User Intent User | User prompt (includes generated user perspective) |
Available placeholders
Prompts support these placeholders, which are replaced at generation time:
| Placeholder | Replaced with |
|---|
{{PATH}} | The specific call flow path being tested |
{{USER_PERSPECTIVE}} | The generated user perspective (for outcome/intent prompts) |
{{VARIANT_TYPE}} | Ring 2 variant label |
{{VARIANT_INSTRUCTIONS}} | Ring 2 variant test instructions |
{{RISK_BEING_TESTED}} | Ring 2 variant risk description |
{{AGENT_TYPE}} | Inbound or outbound |
{{INDUSTRY}} | The project’s industry |
{{PERSPECTIVE_INSTRUCTION}} | Perspective framing based on agent type |
How to edit
- Open the Ring Prompt Editor (accessible from the evaluators page)
- Select the ring you want to customize
- Edit the system and/or user prompts for any of the three fields
- Save — future scenario generation for this ring will use your custom prompts
Word limits
You can also configure word limits per field for each ring. Default limits:
- User Perspective: 150 words
- Expected Outcome: 100 words
- User Intent: 50 words
These can be adjusted per ring in the ring configuration settings.
Modifying ring prompts affects all future scenario generation for that ring. Test changes by generating a small batch before committing to production use.
