Filter class - AWS Glue
Example — methods —__call__applynamedescribeArgsdescribeReturndescribeTransformdescribeErrorsdescribe

Filter class

Builds a new DynamicFrame that contains records from the input DynamicFrame that satisfy a specified predicate function.

Example

We recommend that you use the DynamicFrame.filter() method to filter records in a DynamicFrame. To view a code example, see Example: Use filter to get a filtered selection of fields.

Methods

__call__(frame, f, transformation_ctx="", info="", stageThreshold=0, totalThreshold=0))

Returns a new DynamicFrame that is built by selecting records from the input DynamicFrame that satisfy a specified predicate function.

  • frame – The source DynamicFrame to apply the specified filter function to (required).

  • f – The predicate function to apply to each DynamicRecord in the DynamicFrame. The function must take a DynamicRecord as its argument and return True if the DynamicRecord meets the filter requirements, or False if it doesn't (required).

    A DynamicRecord represents a logical record in a DynamicFrame. It's similar to a row in a Spark DataFrame, except that it is self-describing and can be used for data that doesn't conform to a fixed schema.

  • transformation_ctx – A unique string that is used to identify state information (optional).

  • info – A string that is associated with errors in the transformation (optional).

  • stageThreshold – The maximum number of errors that can occur in the transformation before it errors out (optional). The default is zero.

  • totalThreshold – The maximum number of errors that can occur overall before processing errors out (optional). The default is zero.

apply(cls, *args, **kwargs)

Inherited from GlueTransform apply.

name(cls)

Inherited from GlueTransform name.

describeArgs(cls)

Inherited from GlueTransform describeArgs.

describeReturn(cls)

Inherited from GlueTransform describeReturn.

describeTransform(cls)

Inherited from GlueTransform describeTransform.

describeErrors(cls)

Inherited from GlueTransform describeErrors.

describe(cls)

Inherited from GlueTransform describe.