Create a data flow - Amazon SageMaker

Create a data flow

Use a Data Wrangler flow in SageMaker Canvas, or data flow, to create and modify a data preparation pipeline. We recommend that you use Data Wrangler for datasets larger than 5 GB.

To get started, use the following procedure to import your data into a data flow.

  1. Open SageMaker Canvas.

  2. In the left-hand navigation, choose Data Wrangler.

  3. Choose Import and prepare.

  4. From the dropdown menu, choose either Tabular or Image.

  5. For Select a data source, choose your data source and select the data that you want to import. You have the option to select up to 30 files or one folder. If you have a dataset already imported into Canvas, choose Canvas dataset as your source. Otherwise, connect to a data source such as Amazon S3 or Snowflake and browse through your data. For information about connecting to a data source or importing data, see the following pages:

  6. After selecting the data that you want to import, choose Next.

  7. (Optional) For the Import settings section when importing a tabular dataset, expand the Advanced dropdown menu. You can specify the following advanced settings for data flow imports:

    • Sampling method – Select the sampling method and sample size you'd like to use. For more information about how to change your sample, see the section Edit the data flow sampling configuration.

    • File encoding (CSV) – Select your dataset file’s encoding. UTF-8 is the default.

    • Skip first rows – Enter the number of rows you’d like to skip importing if you have redundant rows at the beginning of your dataset.

    • Delimiter – Select the delimiter that separates each item in your data. You can also specify a custom delimiter.

    • Multi-line detection – Select this option if you’d like Canvas to manually parse your entire dataset for multi-line cells. Canvas determines whether or not to use multi-line support by taking a sample of your data, but Canvas might not detect any multi-line cells in the sample. In this case, we recommend that you select the Multi-line detection option to force Canvas to check your entire dataset for multi-line cells.

  8. Choose Import.

You should now have a new data flow, and you can begin adding transform steps and analyses.