If Firehose encounters errors while delivering or processing data, it retries until the configured retry duration expires. If the retry duration ends before the data is delivered successfully, Firehose backs up the data to the configured S3 backup bucket. If the destination is Amazon S3 and delivery fails or if delivery to the backup S3 bucket fails, Firehose keeps retrying until the retention period ends.
For information about tracking delivery errors using CloudWatch, see Monitor Amazon Data Firehose Using CloudWatch Logs.
For DirectPut Firehose streams, Firehose retains the records for 24 hours. For a
Firehose stream whose data source is a Kinesis data stream, you can change the retention period
as described in Changing the Data Retention Period. In this case, Firehose retries the following
operations indefinitely: DescribeStream, GetRecords, and
GetShardIterator.
If the Firehose stream uses DirectPut, check the IncomingBytes
and IncomingRecords metrics to see if there's incoming traffic. If you are
using the PutRecord or PutRecordBatch, make sure you catch
exceptions and retry. We recommend a retry policy with exponential back-off with jitter and
several retries. Also, if you use the PutRecordBatch API, make sure your code
checks the value of FailedPutCount in the response even when the API call succeeds.
