/AWS1/CL_SGISAMPLEOPCONFIG¶
The configuration for a sampling operation. Exactly one member must be set to specify the operation type.
CONSTRUCTOR¶
IMPORTING¶
Optional arguments:¶
io_sample TYPE REF TO /AWS1/CL_SGISAMPLECONFIG /AWS1/CL_SGISAMPLECONFIG¶
The configuration for generating text samples from the model.
io_computelogprobs TYPE REF TO /AWS1/CL_SGICOMPLOGPROBSCONFIG /AWS1/CL_SGICOMPLOGPROBSCONFIG¶
The configuration for computing log-probabilities of prompt tokens without generating new text.
io_loadweightsforsampling TYPE REF TO /AWS1/CL_SGILOADWGTSFORSMPLCFG /AWS1/CL_SGILOADWGTSFORSMPLCFG¶
The configuration for loading model weights for inference and sampling without restoring optimizer state.
Queryable Attributes¶
sample¶
The configuration for generating text samples from the model.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_SAMPLE() |
Getter for SAMPLE |
computeLogprobs¶
The configuration for computing log-probabilities of prompt tokens without generating new text.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_COMPUTELOGPROBS() |
Getter for COMPUTELOGPROBS |
loadWeightsForSampling¶
The configuration for loading model weights for inference and sampling without restoring optimizer state.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_LOADWEIGHTSFORSAMPLING() |
Getter for LOADWEIGHTSFORSAMPLING |