AutomatedReasoningPolicyTestCase¶
Structure Class¶
AutomatedReasoningPolicyTestCase
dataclass
¶
Represents a test for validating an Automated Reasoning policy. tests contain sample inputs and expected outcomes to verify policy behavior.
Attributes¶
confidence_threshold
class-attribute
instance-attribute
¶
confidence_threshold: float | None = None
The minimum confidence level for logic validation. Content meeting this threshold is considered high-confidence and can be validated.
expected_aggregated_findings_result
class-attribute
instance-attribute
¶
expected_aggregated_findings_result: AutomatedReasoningCheckResult | None = None
The expected result of the Automated Reasoning check for this test.
guard_content
class-attribute
instance-attribute
¶
guard_content: str = field(repr=False)
The output content to be validated by the policy, typically representing a foundation model response.
query_content
class-attribute
instance-attribute
¶
query_content: str | None = field(repr=False, default=None)
The input query or prompt that generated the content. This provides context for the validation.