Glue / Client / list_data_quality_results_v2

list_data_quality_results_v2¶

Glue.Client.list_data_quality_results_v2(**kwargs)¶

Returns a paginated list of data quality execution results for your account, filtered by the specified criteria. Use the NextToken parameter to retrieve additional results.

Request Syntax

response = client.list_data_quality_results_v2(
    Filter={
        'DataSource': {
            'GlueTable': {
                'DatabaseName': 'string',
                'TableName': 'string',
                'CatalogId': 'string',
                'ConnectionName': 'string',
                'AdditionalOptions': {
                    'string': 'string'
                }
            },
            'DataQualityGlueTable': {
                'DatabaseName': 'string',
                'TableName': 'string',
                'CatalogId': 'string',
                'ConnectionName': 'string',
                'AdditionalOptions': {
                    'string': 'string'
                },
                'PreProcessingQuery': 'string'
            }
        },
        'PublishedAfter': datetime(2015, 1, 1),
        'PublishedBefore': datetime(2015, 1, 1),
        'Dimensions': {
            'string': 'string'
        },
        'EvaluationContext': 'string'
    },
    NextToken='string',
    MaxResults=123
)

Parameters:

Filter (dict) –
The filter criteria.
- DataSource (dict) –
  
  The data source used to filter the results. For example, you can retrieve all results for an Glue table. DatabaseName and TableName are required. If you omit CatalogId, the catalog of the calling account is used.
  
  When you filter by data source, a page of results can be empty but still include a NextToken. Keep requesting pages until NextToken is absent.
  - GlueTable (dict) –
    
    An Glue table.
    - DatabaseName (string) – [REQUIRED]
      
      A database name in the Glue Data Catalog.
    - TableName (string) – [REQUIRED]
      
      A table name in the Glue Data Catalog.
    - CatalogId (string) –
      
      A unique identifier for the Glue Data Catalog.
    - ConnectionName (string) –
      
      The name of the connection to the Glue Data Catalog.
    - AdditionalOptions (dict) –
      
      Additional options for the table. Currently there are two keys supported:
      - pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.
      - catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.
      - (string) –
        
        (string) –
  - DataQualityGlueTable (dict) –
    
    An Glue table for Data Quality Operations.
    - DatabaseName (string) – [REQUIRED]
      
      A database name in the Glue Data Catalog.
    - TableName (string) – [REQUIRED]
      
      A table name in the Glue Data Catalog.
    - CatalogId (string) –
      
      A unique identifier for the Glue Data Catalog.
    - ConnectionName (string) –
      
      The name of the connection to the Glue Data Catalog.
    - AdditionalOptions (dict) –
      
      Additional options for the table. Currently there are two keys supported:
      - pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.
      - catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.
      - (string) –
        
        (string) –
    - PreProcessingQuery (string) –
      
      SQL Query of SparkSQL format that can be used to pre-process the data for the table in Glue Data Catalog, before running the Data Quality Operation.
- PublishedAfter (datetime) –
  
  The time after which to include published results.
- PublishedBefore (datetime) –
  
  The time before which to include published results.
- Dimensions (dict) –
  
  The platform dimensions to filter results by.
  - (string) –
    - (string) –
- EvaluationContext (string) –
  
  The evaluation context to filter results by.
NextToken (string) – A pagination token to retrieve the next page of results.
MaxResults (integer) – The maximum number of results to return. If you don’t specify a value, the operation uses the default number of results.

Return type:

dict

Returns:

Response Syntax

{
    'Results': [
        {
            'ResultId': 'string',
            'DataSource': {
                'GlueTable': {
                    'DatabaseName': 'string',
                    'TableName': 'string',
                    'CatalogId': 'string',
                    'ConnectionName': 'string',
                    'AdditionalOptions': {
                        'string': 'string'
                    }
                },
                'DataQualityGlueTable': {
                    'DatabaseName': 'string',
                    'TableName': 'string',
                    'CatalogId': 'string',
                    'ConnectionName': 'string',
                    'AdditionalOptions': {
                        'string': 'string'
                    },
                    'PreProcessingQuery': 'string'
                }
            },
            'ResultPublishedOn': datetime(2015, 1, 1),
            'Dimensions': {
                'string': 'string'
            },
            'EvaluationContext': 'string',
            'Descriptors': {
                'string': 'string'
            }
        },
    ],
    'NextToken': 'string'
}

Response Structure

(dict) –
- Results (list) –
  
  A list of DataQualityResultsV2Description objects.
  - (dict) –
    
    Describes a data quality result returned by ListDataQualityResultsV2.
    - ResultId (string) –
      
      The unique result ID for this data quality result.
    - DataSource (dict) –
      
      The table associated with the data quality result, if any.
      - GlueTable (dict) –
        
        An Glue table.
        
        DatabaseName (string) –
        
        A database name in the Glue Data Catalog.
        
        TableName (string) –
        
        A table name in the Glue Data Catalog.
        
        CatalogId (string) –
        
        A unique identifier for the Glue Data Catalog.
        
        ConnectionName (string) –
        
        The name of the connection to the Glue Data Catalog.
        
        AdditionalOptions (dict) –
        
        Additional options for the table. Currently there are two keys supported:
        
        pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.
        
        catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.
        
        (string) –
        
        (string) –
      - DataQualityGlueTable (dict) –
        
        An Glue table for Data Quality Operations.
        
        DatabaseName (string) –
        
        A database name in the Glue Data Catalog.
        
        TableName (string) –
        
        A table name in the Glue Data Catalog.
        
        CatalogId (string) –
        
        A unique identifier for the Glue Data Catalog.
        
        ConnectionName (string) –
        
        The name of the connection to the Glue Data Catalog.
        
        AdditionalOptions (dict) –
        
        Additional options for the table. Currently there are two keys supported:
        
        pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.
        
        catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.
        
        (string) –
        
        (string) –
        
        PreProcessingQuery (string) –
        
        SQL Query of SparkSQL format that can be used to pre-process the data for the table in Glue Data Catalog, before running the Data Quality Operation.
    - ResultPublishedOn (datetime) –
      
      The date and time when this data quality result was published.
    - Dimensions (dict) –
      
      A map of platform-specific identifiers, such as cluster, application, workgroup, or project IDs, that identify where the data quality evaluation ran.
      - (string) –
        
        (string) –
    - EvaluationContext (string) –
      
      The evaluation context for the data quality result. This value identifies a specific data quality result, or a series of related results, within a run.
    - Descriptors (dict) –
      
      A map of user-provided descriptors that add contextual metadata and configuration to the data quality result, such as database name, table name, team, or environment.
      - (string) –
        
        (string) –
- NextToken (string) –
  
  A pagination token, if more results are available.

Exceptions

Glue.Client.exceptions.InvalidInputException
Glue.Client.exceptions.OperationTimeoutException
Glue.Client.exceptions.InternalServiceException