Class: Aws::SageMakerTrainingSessionRuntime::Types::SampleTokenUsage

Inherits:

Struct

• Object
• Struct
• Aws::SageMakerTrainingSessionRuntime::Types::SampleTokenUsage

Defined in:

gems/aws-sdk-sagemakertrainingsessionruntime/lib/aws-sdk-sagemakertrainingsessionruntime/types.rb

Overview

The token usage statistics for a sample generation.

See Also:

• AWS API Documentation

Constant Summary

SENSITIVE =

[]

Instance Attribute Summary

• #decode ⇒ Integer

  The number of tokens generated (decode phase).

• #prefill ⇒ Integer

  The number of tokens in the input prompt (prefill phase).

Instance Attribute Details

#decode ⇒ Integer

The number of tokens generated (decode phase).

Returns:

• (Integer)

# File 'gems/aws-sdk-sagemakertrainingsessionruntime/lib/aws-sdk-sagemakertrainingsessionruntime/types.rb', line 847

class SampleTokenUsage < Struct.new(
  :prefill,
  :decode)
  SENSITIVE = []
  include Aws::Structure
end

#prefill ⇒ Integer

The number of tokens in the input prompt (prefill phase).

Returns:

• (Integer)

# File 'gems/aws-sdk-sagemakertrainingsessionruntime/lib/aws-sdk-sagemakertrainingsessionruntime/types.rb', line 847

class SampleTokenUsage < Struct.new(
  :prefill,
  :decode)
  SENSITIVE = []
  include Aws::Structure
end