Note
You can use AWS Glue for Spark to read from and write to tables in Google BigQuery in AWS Glue 4.0 and later versions. To configure Google BigQuery with AWS Glue jobs programmatically, see BigQuery connections.
AWS Glue Studio provides a visual interface to connect to BigQuery, author data integration jobs, and run them on the AWS Glue Studio serverless Spark runtime.
When creating a connection to Goolge BigQuery in AWS Glue Studio, a unified connection is created. For more information, see Considerations.
Instead of creating a secret with the credentials in a specific format, {"credentials": "base64 encoded JSON"}
,
now with unified connection to Google BigQuery, you can create a secret which directly includes the JSON from Goolge BigQuery:
{"type": "service-account", ...}
.
Topics
Advanced options
You can provide advanced options when creating a BigQuery node. These options are the same as those available when programming AWS Glue for Spark scripts.
See BigQuery connection option reference in the AWS Glue developer guide.