CircleCI supports custom authentication.
To configure a CircleCI connection:
In AWS Secrets Manager, create a secret with the following details:
For the customer managed connected app, the Secret should contain the connected app API key with
Circle-Token
as key.Note: you must create a secret for your connections in AWS Glue.
In AWS Glue Glue Studio, create a connection under Data Connections by following the steps below:
When selecting a Data Source, select CircleCI.
Select the AWS IAM role which AWS Glue can assume and has permissions for following actions:
{ "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "secretsmanager:DescribeSecret", "secretsmanager:GetSecretValue", "secretsmanager:PutSecretValue", "ec2:CreateNetworkInterface", "ec2:DescribeNetworkInterface", "ec2:DeleteNetworkInterface", ], "Resource": "*" } ] }
Select the
secretName
which you want to use for this connection in AWS Glue to put the tokens.Select the network options if you want to use your network.
Grant the IAM role associated with your AWS Glue job permission to read
secretName
.