Configuring each feature

Following are details about how to configure each feature (output) that you include in a Elemental Inference feed.

Configuring event clipping

In Callback config, you can enter a string that you want Elemental Inference to always include in the event clipping metadata for this output. This information is useful when you later work with Elemental Inference events in Amazon EventBridge. You will be able to filter events using this information, in order to find the events for one feed. The string might identify the sports event in the feed, for example.

Configuring smart crop

Smart crop has no required configuration. Optionally, you can add graphic composition to a smart crop output to detect known graphics, such as scoreboards and advertisements, in your source media. You provide one or more reference images, called templates, and Elemental Inference reports, for each analyzed frame, whether each graphic is present and where it appears as a bounding box. Elemental Inference returns graphic composition results as part of the smart crop metadata. For more information, see Metadata for graphic composition.

You can configure one to four template groups of reference images, where each group represents a single graphic to detect. Configuring at least one group enables graphic composition in the output. Each group has the following settings:

Template image recommendations

For the best detection performance, follow these recommendations when you prepare your template images:

CLI example

The following example shows how to include a smart crop output that detects two graphics, a scoreboard and ads, when creating a feed using the CLI:

aws elemental-inference create-feed \
  --name "my-feed" \
  --access-role-arn "arn:aws:iam::111122223333:role/my-ei-access-role" \
  --outputs '[{
    "name": "crop",
    "status": "ENABLED",
    "outputConfig": {
      "cropping": {
        "templateGroups": [
          {
            "name": "scoreboard",
            "templateUris": [
              "s3://amzn-s3-demo-bucket/scoreboard-v1.png",
              "s3://amzn-s3-demo-bucket/scoreboard-v2.png"
            ]
          },
          {
            "name": "ads",
            "templateUris": [
              "s3://amzn-s3-demo-bucket/ads.png"
            ]
          }
        ]
      }
    }
  }]'

Configuring smart subtitles

Smart subtitles uses automatic speech recognition (ASR) to generate TTML subtitles from the audio in your source media. Configure the following settings for the smart subtitles output:

CLI example

The following example shows how to include a smart subtitles output when creating a feed using the CLI:

aws elemental-inference create-feed \
  --name "my-feed" \
  --outputs '[{
    "name": "subtitles",
    "status": "ENABLED",
    "outputConfig": {
      "subtitling": {
        "language": "eng",
        "aspectRatio": {"width": 16, "height": 9},
        "profanityFilter": "DISABLED"
      }
    }
  }]'

Managing dictionaries

A dictionary contains custom words and phrases that the ASR engine might not recognize, such as brand names, technical terms, or proper nouns. You can reference a dictionary when configuring a smart subtitles output to improve transcription accuracy for domain-specific terminology.

Use the Elemental Inference dictionary API operations to manage dictionaries:

Dictionary validation rules

When creating or updating a dictionary, the following validation rules apply: