Tutorial: Stream JSON Log Files to Amazon S3 Using Kinesis Agent for Windows
This tutorial presents detailed steps for setting up a data pipeline using Amazon Kinesis Agent for Microsoft Windows (Kinesis Agent for Windows).
The tutorial includes the following steps:
-
Using Kinesis Agent for Windows to stream JSON-formatted log files to Amazon Simple Storage Service (Amazon S3) via Amazon Data Firehose. For information about Kinesis Agent for Windows, see What Is Amazon Kinesis Agent for Microsoft Windows?.
-
Enhancing the log data before streaming using object decoration. For more information, see Configuring Sink Decorations.
-
Using Amazon Athena to search for particular kinds of log records.
Prerequisites
If you don't already have an AWS account, follow the instructions in Setting Up an AWS Account to get one.
Topics
Next Steps
Use the AWS Management Console to clean up the resources created during the tutorial:
-
Terminate the EC2 instance (see step 3 in Getting Started with Amazon EC2 Windows Instances).
Important
If you launched an instance that was not within the AWS Free Tier
, you are charged for the instance until you terminate it. Delete the Firehose delivery stream.
Open the Firehose console at https://console.aws.amazon.com/firehose/
. -
Choose the delivery stream that you created.
-
Choose Delete.
-
Choose Delete delivery stream.
-
Delete the S3 bucket. For instructions, see How Do I Delete an S3 Bucket? in the Amazon Simple Storage Service User Guide.
For more information, see the following topics:
