Select your cookie preferences

We use essential cookies and similar tools that are necessary to provide our site and services. We use performance cookies to collect anonymous statistics, so we can understand how customers use our site and make improvements. Essential cookies cannot be deactivated, but you can choose “Customize” or “Decline” to decline performance cookies.

If you agree, AWS and approved third parties will also use cookies to provide useful site features, remember your preferences, and display relevant content, including relevant advertising. To accept or decline all non-essential cookies, choose “Accept” or “Decline.” To make more detailed choices, choose “Customize.”

Overview of SelectFromCollection transform

Focus mode
Overview of SelectFromCollection transform - AWS Glue

Certain transforms have multiple datasets as their output instead of a single dataset, for example, SplitFields. The SelectFromCollection transform selects one dataset (DynamicFrame) from a collection of datasets (an array of DynamicFrames). The output for the transform is the selected DynamicFrame.

You must use this transform after you use a transform that creates a collection of DynamicFrames, such as:

  • Custom code transforms

  • SplitFields

If you don't add a SelectFromCollection transform node to your job diagram after any of these transforms, you will get an error for your job.

The parent node for this transform must be a node that returns a collection of DynamicFrames. If you choose a parent for this transform node that returns a single DynamicFrame, such as a Join transform, your job returns an error.

Similarly, if you use a SelectFromCollection node in your job diagram as the parent for a transform that expects a single DynamicFrame as input, your job returns an error.

The screenshot shows the Node parents field on the Node properties tab of the node details panel. The selected node parent is SplitFields and the error message displayed reads "Parent node Split Fields outputs a collection, but node Drop Fields does not accept a collection."
PrivacySite termsCookie preferences
© 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved.