/AWS1/CL_SGISAMPLECONFIG¶
The configuration for generating text samples from the model.
CONSTRUCTOR¶
IMPORTING¶
Required arguments:¶
io_prompt TYPE REF TO /AWS1/CL_SGIMODELINPUT /AWS1/CL_SGIMODELINPUT¶
The input prompt to send to the model for text generation.
iv_numsamples TYPE /AWS1/SGIINTEGER /AWS1/SGIINTEGER¶
The number of independent samples to generate for the prompt.
io_samplingparams TYPE REF TO /AWS1/CL_SGISAMPLINGPARAMS /AWS1/CL_SGISAMPLINGPARAMS¶
The parameters controlling the sampling strategy.
Optional arguments:¶
iv_includepromptlogprobs TYPE /AWS1/SGIBOOLEAN /AWS1/SGIBOOLEAN¶
Specifies whether to include per-token log-probabilities for the input prompt in the response.
iv_topkpromptlogprobs TYPE /AWS1/SGIINTEGER /AWS1/SGIINTEGER¶
The number of top-k log-probabilities to return per prompt token.
iv_modelpackagearn TYPE /AWS1/SGISTRING /AWS1/SGISTRING¶
The ARN of the model package whose checkpoint this sample should run against. Must be a valid SageMaker model package ARN in the format
arn:aws:sagemaker:REGION:ACCOUNT:model-package/PACKAGE_NAME/VERSION. When absent, the sample runs against the session's latest checkpoint.
Queryable Attributes¶
prompt¶
The input prompt to send to the model for text generation.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_PROMPT() |
Getter for PROMPT |
numSamples¶
The number of independent samples to generate for the prompt.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_NUMSAMPLES() |
Getter for NUMSAMPLES, with configurable default |
ASK_NUMSAMPLES() |
Getter for NUMSAMPLES w/ exceptions if field has no value |
HAS_NUMSAMPLES() |
Determine if NUMSAMPLES has a value |
samplingParams¶
The parameters controlling the sampling strategy.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_SAMPLINGPARAMS() |
Getter for SAMPLINGPARAMS |
includePromptLogprobs¶
Specifies whether to include per-token log-probabilities for the input prompt in the response.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_INCLUDEPROMPTLOGPROBS() |
Getter for INCLUDEPROMPTLOGPROBS |
topkPromptLogprobs¶
The number of top-k log-probabilities to return per prompt token.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_TOPKPROMPTLOGPROBS() |
Getter for TOPKPROMPTLOGPROBS |
modelPackageArn¶
The ARN of the model package whose checkpoint this sample should run against. Must be a valid SageMaker model package ARN in the format
arn:aws:sagemaker:REGION:ACCOUNT:model-package/PACKAGE_NAME/VERSION. When absent, the sample runs against the session's latest checkpoint.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_MODELPACKAGEARN() |
Getter for MODELPACKAGEARN, with configurable default |
ASK_MODELPACKAGEARN() |
Getter for MODELPACKAGEARN w/ exceptions if field has no val |
HAS_MODELPACKAGEARN() |
Determine if MODELPACKAGEARN has a value |