Read data from Amazon Kinesis Data Streams
A consumer is an application that processes all data from a Kinesis data stream. When a consumer uses enhanced fan-out, it gets its own 2 MB/sec allotment of read throughput, allowing multiple consumers to read data from the same stream in parallel, without contending for read throughput with other consumers. To use the enhanced fan-out capability of shards, see Develop enhanced fan-out consumers with dedicated throughput.
You can build consumers for Kinesis Data Streams using Kinesis Client Library (KCL) or AWS SDK for Java. You can also develop consumers using other AWS services such as AWS Lambda, Amazon Managed Service for Apache Flink, and Amazon Data Firehose. Kinesis Data Streams supports integrations with other AWS services such as Amazon EMR, Amazon EventBridge, AWS Glue, and Amazon Redshift It also supports third party integrations including Apache Flink, Adobe Experience Platform, Apache Druid, Apache Spark, Databricks, Confluent Platform, Kinesumer, and Talend.
Topics
- Develop enhanced fan-out consumers with dedicated throughput
- Use the Data Viewer in the Kinesis console
- Query your data streams in the Kinesis console
- Use Kinesis Client Library
- Develop consumers with the AWS SDK for Java
- Develop consumers using AWS Lambda
- Develop consumers using Amazon Managed Service for Apache Flink
- Develop consumers using Amazon Data Firehose
- Read data from Kinesis Data Streams using other AWS services
- Read from Kinesis Data Streams using third-party integrations
- Troubleshoot Kinesis Data Streams consumers
- Optimize Amazon Kinesis Data Streams consumers
