Reviewing inappropriate content with Amazon Augmented AI

Running DetectModerationLabels with Amazon A2I

1. Complete the prerequisites that are listed in Getting Started with Amazon Augmented AI in the SageMaker Documentation.

   Additionally, remember to set up your IAM permissions as in the page Permissions and Security in Amazon Augmented AI in the SageMaker Documentation.

2. Follow the instructions for Creating a Human Review Workflow in the SageMaker Documentation.

   A human review workflow manages the processing of an image. It holds the conditions that trigger a human review, the work team that the image is sent to, the UI template that the work team uses, and the Amazon S3 bucket that the work team's results are sent to.

   Within your CreateFlowDefinition call, you need to set the HumanLoopRequestSource to "AWS/Rekognition/DetectModerationLabels/Image/V3". After that, you need to decide how you want to set up your conditions that trigger human review.

   With Amazon Rekognition you have two options for ConditionType: ModerationLabelConfidenceCheck, and Sampling.

   ModerationLabelConfidenceCheck creates a human loop when confidence of a moderation label is within a range. Finally, Sampling sends a random percent of the documents processed for human review. Each ConditionType uses a different set of ConditionParameters to set what results in human review.

   ModerationLabelConfidenceCheck has the ConditionParameters ModerationLableName which sets the key that needs to be reviewed by humans. Additionally, it has confidence, which set the percentage range for sending to human review with LessThan, GreaterThan, and Equals. Sampling has RandomSamplingPercentage which sets a percent of documents that will be sent to human review.

   The following code example is a partial call of CreateFlowDefinition. It sends an image for human review if it's rated less than 98% on the label "Suggestive", and more than 95% on the label "Female Swimwear or Underwear". This means that if the image isn't considered suggestive but does have a woman in underwear or swimwear, you can double check the image by using human review.

   
       def create_flow_definition():
       '''
       Creates a Flow Definition resource
   
       Returns:
       struct: FlowDefinitionArn
       '''
       humanLoopActivationConditions = json.dumps(
           {
               "Conditions": [
                   {
                     "And": [
                       {
                           "ConditionType": "ModerationLabelConfidenceCheck",
                           "ConditionParameters": {
                               "ModerationLabelName": "Suggestive",
                               "ConfidenceLessThan": 98
                           }
                       },
                       {
                           "ConditionType": "ModerationLabelConfidenceCheck",
                           "ConditionParameters": {
                               "ModerationLabelName": "Female Swimwear Or Underwear",
                               "ConfidenceGreaterThan": 95
                           }
                       }
                     ]
                  }
               ]
           }
       )
   
          

   CreateFlowDefinition returns a FlowDefinitionArn, which you use in the next step when you call DetectModerationLabels.

   For more information see CreateFlowDefinition in the SageMaker API Reference.

3. Set the HumanLoopConfig parameter when you call DetectModerationLabels, as in Detecting inappropriate images. See step 4 for examples of a DetectModerationLabels call with HumanLoopConfig set.

   1. Within the HumanLoopConfig parameter, set the FlowDefinitionArn to the ARN of the flow definition that you created in step 2.

   2. Set your HumanLoopName. This should be unique within a Region and must be lowercase.

   3. (Optional) You can use DataAttributes to set whether or not the image you passed to Amazon Rekognition is free of personally identifiable information. You must set this parameter in order to send information to Amazon Mechanical Turk.

4. Run DetectModerationLabels.

   The following examples show how to use the AWS CLI and AWS SDK for Python (Boto3) to run DetectModerationLabels with HumanLoopConfig set.

   AWS SDK for Python (Boto3)

   The following request example uses the SDK for Python (Boto3). For more information, see detect_moderation_labels in the AWS SDK for Python (Boto) API Reference.

   import boto3
   
   rekognition = boto3.client("rekognition", aws-region)
   
   response = rekognition.detect_moderation_labels( \
           Image={'S3Object': {'Bucket': bucket_name, 'Name': image_name}}, \
           HumanLoopConfig={ \
               'HumanLoopName': 'human_loop_name', \
               'FlowDefinitionArn': , "arn:aws:sagemaker:aws-region:aws_account_number:flow-definition/flow_def_name" \
               'DataAttributes': {'ContentClassifiers': ['FreeOfPersonallyIdentifiableInformation','FreeOfAdultContent']}
            })
   

   AWS CLI

   The following request example uses the AWS CLI. For more information, see detect-moderation-labels in the AWS CLI Command Reference.

   $ aws rekognition detect-moderation-labels \
       --image "S3Object={Bucket='bucket_name',Name='image_name'}" \
       --human-loop-config HumanLoopName="human_loop_name",FlowDefinitionArn="arn:aws:sagemaker:aws-region:aws_account_number:flow-definition/flow_def_name",DataAttributes='{ContentClassifiers=["FreeOfPersonallyIdentifiableInformation", "FreeOfAdultContent"]}'
   

   $ aws rekognition detect-moderation-labels \
       --image "S3Object={Bucket='bucket_name',Name='image_name'}" \
       --human-loop-config \
           '{"HumanLoopName": "human_loop_name", "FlowDefinitionArn": "arn:aws:sagemaker:aws-region:aws_account_number:flow-definition/flow_def_name", "DataAttributes": {"ContentClassifiers": ["FreeOfPersonallyIdentifiableInformation", "FreeOfAdultContent"]}}'
   

   When you run DetectModerationLabels with HumanLoopConfig enabled, Amazon Rekognition calls the SageMaker API operation StartHumanLoop. This command takes the response from DetectModerationLabels and checks it against the flow definition's conditions in the example. If it meets the conditions for review, it returns a HumanLoopArn. This means that the members of the work team that you set in your flow definition now can review the image. Calling the Amazon Augmented AI runtime operation DescribeHumanLoop provides information about the outcome of the loop. For more information, see DescribeHumanLoop in the Amazon Augmented AI API Reference documentation.

   After the image has been reviewed, you can see the results in the bucket that is specified in your flow definition's output path. Amazon A2I will also notify you with Amazon CloudWatch Events when the review is complete. To see what events to look for, see CloudWatch Events in the SageMaker Documentation.

   For more information, see Getting Started with Amazon Augmented AI in the SageMaker Documentation.