Magics supported by AWS Glue Ray interactive sessions
Magics for the AWS Glue Jupyter kernel when it powers Ray interactive sessions are similar to those for the Spark sessions. For reference, see Configuring AWS Glue interactive sessions for Jupyter and AWS Glue Studio notebooks .
Sessions magics
Sessions magics are mostly the same as prior to the AWS Glue for Ray preview. For more information about session magics outside of this preview, see Magics supported by AWS Glue interactive sessions for Jupyter . We introduce a new magic to set the session type to AWS Glue for Ray.
| Name | Type | Description |
|---|---|---|
%glue_ray
|
String | Changes the session type to AWS Glue for Ray. |
AWS Glue config magics
Magics to configure AWS Glue in an interactive session may be different between session types. Currently, we only support this subset of existing magics when using AWS Glue for Ray.
Warning
Known Issue: additional_python_modules
In the Ray interactive sessions preview, use of the additional_python_modules magic will
cause problems when saving your notebook. To configure python modules for Ray sessions, use
the %%configure magic to set the pip-install parameter defined in Using job parameters in Ray jobs.
| Name | Type | Description |
|---|---|---|
%%configure
|
Dictionary | Specify a JSON-formatted dictionary consisting of all configuration parameters for a session. Each parameter can be specified here or through individual magics. |
%iam_role |
String | Specify an IAM role ARN to execute your session with. Default from ~/.aws/configure |
%number_of_workers |
int | The number of workers of a defined worker_type that are allocated when a job runs.
worker_type must be set too. |
%worker_type |
String | In the AWS Glue for Ray preview, the only supported worker type is Z.2X. |
%additional_python_modules |
List | Comma separated list of additional Python modules to include in your cluster (can be from Pypi or S3). |
Action magics
AWS Glue Ray sessions do not support any action magics.
