GoogleCloudDataprocClusterConfiguration

No description

type GoogleCloudDataprocClusterConfiguration {
  autoscalingConfiguration: GoogleCloudDataprocClusterAutoscalingConfiguration
  auxiliaryNodeGroups: [GoogleCloudDataprocClusterAuxiliaryNodeGroup!]!
  bucket: String!
  encryptionConfiguration: GoogleCloudDataprocClusterEncryptionConfiguration
  endpointConfiguration: GoogleCloudDataprocClusterEndpointConfiguration
  gceClusterConfiguration: GoogleCloudDataprocClusterGceClusterConfiguration
  gkeClusterConfiguration: GoogleCloudDataprocClusterGkeClusterConfiguration
  initializationActions: [GoogleCloudDataprocClusterInitializationAction!]!
  lifecycleConfiguration: GoogleCloudDataprocClusterLifecycleConfiguration
  masterConfiguration: GoogleCloudDataprocClusterInstanceGroupConfiguration
  metastoreConfiguration: GoogleCloudDataprocClusterMetastoreConfiguration
  secondaryWorkerConfiguration: GoogleCloudDataprocClusterInstanceGroupConfiguration
  securityConfiguration: GoogleCloudDataprocClusterSecurityConfiguration
  softwareConfiguration: GoogleCloudDataprocClusterSoftwareConfiguration
  tempBucket: String!
  workerConfiguration: GoogleCloudDataprocClusterInstanceGroupConfiguration
}

Fields

GoogleCloudDataprocClusterConfiguration.autoscalingConfiguration ● GoogleCloudDataprocClusterAutoscalingConfiguration object

Autoscaling config for the policy associated with the cluster

GoogleCloudDataprocClusterConfiguration.auxiliaryNodeGroups ● [GoogleCloudDataprocClusterAuxiliaryNodeGroup!]! non-null object

The node group settings.

GoogleCloudDataprocClusterConfiguration.bucket ● String! non-null scalar

A Cloud Storage bucket used to stage job dependencies, config files, and job driver console output

GoogleCloudDataprocClusterConfiguration.encryptionConfiguration ● GoogleCloudDataprocClusterEncryptionConfiguration object

Encryption settings for the cluster

GoogleCloudDataprocClusterConfiguration.endpointConfiguration ● GoogleCloudDataprocClusterEndpointConfiguration object

Port/endpoint configuration for this cluster

GoogleCloudDataprocClusterConfiguration.gceClusterConfiguration ● GoogleCloudDataprocClusterGceClusterConfiguration object

The shared Compute Engine config settings for all instances in a cluster

GoogleCloudDataprocClusterConfiguration.gkeClusterConfiguration ● GoogleCloudDataprocClusterGkeClusterConfiguration object

BETA. The Kubernetes Engine config for Dataproc clusters deployed to The Kubernetes Engine config for Dataproc clusters deployed to Kubernetes. These config settings are mutually exclusive with Compute Engine-based options, such as gce_cluster_config, master_config, worker_config, secondary_worker_config, and autoscaling_config.

GoogleCloudDataprocClusterConfiguration.initializationActions ● [GoogleCloudDataprocClusterInitializationAction!]! non-null object

Commands to execute on each node after config is completed

GoogleCloudDataprocClusterConfiguration.lifecycleConfiguration ● GoogleCloudDataprocClusterLifecycleConfiguration object

Lifecycle setting for the cluster

GoogleCloudDataprocClusterConfiguration.masterConfiguration ● GoogleCloudDataprocClusterInstanceGroupConfiguration object

The Compute Engine config settings for the cluster's master instance

GoogleCloudDataprocClusterConfiguration.metastoreConfiguration ● GoogleCloudDataprocClusterMetastoreConfiguration object

Metastore configuration

GoogleCloudDataprocClusterConfiguration.secondaryWorkerConfiguration ● GoogleCloudDataprocClusterInstanceGroupConfiguration object

The Compute Engine config settings for a cluster's secondary worker instances

GoogleCloudDataprocClusterConfiguration.securityConfiguration ● GoogleCloudDataprocClusterSecurityConfiguration object

Security settings for the cluster

GoogleCloudDataprocClusterConfiguration.softwareConfiguration ● GoogleCloudDataprocClusterSoftwareConfiguration object

The config settings for cluster software

GoogleCloudDataprocClusterConfiguration.tempBucket ● String! non-null scalar

A Cloud Storage bucket used to store ephemeral cluster and jobs data, such as Spark and MapReduce history files

GoogleCloudDataprocClusterConfiguration.workerConfiguration ● GoogleCloudDataprocClusterInstanceGroupConfiguration object

The Compute Engine config settings for the cluster's worker instances

Member of

GoogleCloudDataprocCluster object