AWS Glue Dev Endpoint
This page shows how to write Terraform and CloudFormation for AWS Glue Dev Endpoint and write them securely.
aws_glue_dev_endpoint (Terraform)
The Dev Endpoint in AWS Glue can be configured in Terraform with the resource name aws_glue_dev_endpoint
. The following sections describe 1 example of how to use the resource and its parameters.
Example Usage from GitHub
resource "aws_glue_dev_endpoint" "privesc-glue-devendpoint" {
name = "privesc-glue-devendpoint"
role_arn = aws_iam_role.privesc-glue-devendpoint-role.arn
}
resource "aws_iam_role" "privesc-glue-devendpoint-role" {
Parameters
-
arguments
optional - map from string to string -
arn
optional computed - string -
availability_zone
optional computed - string -
extra_jars_s3_path
optional - string -
extra_python_libs_s3_path
optional - string -
failure_reason
optional computed - string -
glue_version
optional - string -
id
optional computed - string -
name
required - string -
number_of_nodes
optional - number -
number_of_workers
optional - number -
private_address
optional computed - string -
public_address
optional computed - string -
public_key
optional - string -
public_keys
optional - set of string -
role_arn
required - string -
security_configuration
optional - string -
security_group_ids
optional - set of string -
status
optional computed - string -
subnet_id
optional - string -
tags
optional - map from string to string -
vpc_id
optional computed - string -
worker_type
optional - string -
yarn_endpoint_address
optional computed - string -
zeppelin_remote_spark_interpreter_port
optional computed - number
Explanation in Terraform Registry
Provides a Glue Development Endpoint resource.
AWS::Glue::DevEndpoint (CloudFormation)
The DevEndpoint in Glue can be configured in CloudFormation with the resource name AWS::Glue::DevEndpoint
. The following sections describe 10 examples of how to use the resource and its parameters.
Example Usage from GitHub
Type: AWS::Glue::DevEndpoint
Properties:
NumberOfWorkers: 2
WorkerType: Standard
RoleArn: !GetAtt SageMakerNotebookInstance1ExecutionRole.Arn
Tags: {
Type: AWS::Glue::DevEndpoint
DeletionPolicy: "Delete"
DependsOn: "SecurityGroupIgress2"
Properties:
Arguments:
GLUE_PYTHON_VERSION: 3
Type: AWS::Glue::DevEndpoint
Properties:
EndpointName: !Join [ '-', [!Ref StackPrefix, 'Glue-Dev-Endpoint'] ]
Arguments: { "--enable-glue-datacatalog": "" }
GlueVersion: 1.0
#NumberOfNodes: 3
Type: AWS::Glue::DevEndpoint
Properties:
EndpointName: !Ref EndpointName
NumberOfNodes: !Ref NumberOfNode
PublicKey:
Fn::FindInMap:
Type: "AWS::Glue::DevEndpoint"
Properties:
EndpointName: partition-endpoint
PublicKey: !Ref PublicKeyParameter
RoleArn: !GetAtt GlueRole.Arn
"AWS::Glue::DevEndpoint": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-devendpoint.html",
"Properties": {
"ExtraJarsS3Path": {
"Required": false,
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-devendpoint.html#cfn-glue-devendpoint-extrajarss3path",
"AWS::Glue::DevEndpoint": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-devendpoint.html",
"Properties": {
"ExtraJarsS3Path": {
"Required": false,
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-devendpoint.html#cfn-glue-devendpoint-extrajarss3path",
"AWS::Glue::DevEndpoint": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-devendpoint.html",
"Properties": {
"ExtraJarsS3Path": {
"Required": false,
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-devendpoint.html#cfn-glue-devendpoint-extrajarss3path",
"AWS::Glue::DevEndpoint": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-devendpoint.html",
"Properties": {
"ExtraJarsS3Path": {
"Required": false,
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-devendpoint.html#cfn-glue-devendpoint-extrajarss3path",
"AWS::Glue::DevEndpoint": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-devendpoint.html",
"Properties": {
"ExtraJarsS3Path": {
"Required": false,
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-devendpoint.html#cfn-glue-devendpoint-extrajarss3path",
Parameters
-
ExtraJarsS3Path
optional - String -
PublicKey
optional - String -
NumberOfNodes
optional - Integer -
Arguments
optional - Json -
SubnetId
optional - String -
PublicKeys
optional - List -
SecurityGroupIds
optional - List -
RoleArn
required - String -
WorkerType
optional - String -
EndpointName
optional - String -
GlueVersion
optional - String -
ExtraPythonLibsS3Path
optional - String -
SecurityConfiguration
optional - String -
NumberOfWorkers
optional - Integer -
Tags
optional - Json
Explanation in CloudFormation Registry
The
AWS::Glue::DevEndpoint
resource specifies a development endpoint where a developer can remotely debug ETL scripts for AWS Glue. For more information, see DevEndpoint Structure in the AWS Glue Developer Guide.
Frequently asked questions
What is AWS Glue Dev Endpoint?
AWS Glue Dev Endpoint is a resource for Glue of Amazon Web Service. Settings can be wrote in Terraform and CloudFormation.
Where can I find the example code for the AWS Glue Dev Endpoint?
For Terraform, the BishopFox/iam-vulnerable source code example is useful. See the Terraform Example section for further details.
For CloudFormation, the zoph-io/instance-watcher, goodbyegangster/cloudformation and nmukerje/GlueWorkshop source code examples are useful. See the CloudFormation Example section for further details.