Understanding Rekognition's image and video operations
Amazon Rekognition offers two primary API sets for image and video analysis:
-
Amazon Rekognition Image: This API is designed for analyzing images.
-
Amazon Rekognition Video: This API focuses on analyzing both stored and streaming videos.
Both APIs can detect various entities such as faces and objects. For a comprehensive understanding of the comparison and detection types supported, refer to the section on Understanding Rekognition's types of analysis.
Amazon Rekognition Image operations
Amazon Rekognition Image operations are synchronous. The input and response are in JSON format. Amazon Rekognition Image operations analyze an input image that is in .jpg or .png image format. The image passed to an Amazon Rekognition Image operation can be stored in an Amazon S3 bucket. If you are not using the AWS CLI, you can also pass Base64 encoded images bytes directly to an Amazon Rekognition operation. For more information, see Working with images.
Amazon Rekognition Video operations
The Amazon Rekognition Video API facilitates the analysis of videos either stored in an Amazon S3 bucket or streamed via Amazon Kinesis Video Streams.
For stored video operations, note the following:
-
Operations are asynchronous.
-
Analysis must be initiated with a “Start” operation (e.g., StartFaceDetection for face detection in stored videos).
-
The completion status of analysis is published to an Amazon SNS topic.
-
To retrieve the results of an analysis, use the corresponding “Get” operation (e.g., GetFaceDetection).
-
For more information, see Working with stored video analysis.
For streaming video analysis:
-
Capabilities include face search in Rekognition Video collections and label (object or concept) detection.
-
Analysis results for labels are sent as Amazon SNS and Amazon S3 notifications.
-
Face search results are output to a Kinesis data stream.
-
Management of streaming video analysis is done via an Amazon Rekognition Video stream processor (e.g., create a processor using CreateStreamProcessor).
-
For more information, see Working with streaming video events.
Each video analysis operation returns metadata about the video being analyzed, as well as a job ID and a job tag. Operations like Label Detection and Content Moderation for video allow sorting by timestamp or label name, and aggregating results by timestamp or by segment.
Non-storage and storage-based operations
Amazon Rekognition operations are grouped into the following categories.
-
Non-storage API operations – In these operations, Amazon Rekognition doesn't persist any information. You provide input images and videos, the operation performs the analysis, and returns results, but nothing is saved by Amazon Rekognition. For more information, see Non-storage operations.
-
Storage-based API operations – Amazon Rekognition servers can store detected facial information in containers known as collections. Amazon Rekognition provides additional API operations you can use to search the persisted face information for face matches. For more information, see Storage-based API operations.
Using the AWS SDK or HTTP to call Amazon Rekognition API operations
You can call Amazon Rekognition API operations using either the AWS SDK or directly by using HTTP. Unless you have a good reason not to, you should always use the AWS SDK. The Java examples in this section use the AWS SDK. A Java project file is not provided, but you can use the AWS Toolkit for Eclipse to develop AWS applications using Java.
The .NET examples in this section use the AWS SDK for .NET. You can use the AWS Toolkit for Visual Studio to develop AWS applications using .NET. It includes helpful templates and the AWS Explorer for deploying applications and managing services.
The API Reference in this guide covers calling Amazon Rekognition operations using HTTP. For Java reference information, see AWS SDK for Java.
The Amazon Rekognition service endpoints you can use are documented at AWS Regions and Endpoints.
When calling Amazon Rekognition with HTTP, use POST HTTP operations.
