Skip to main content

GoogleCloudDataprocClusterConfiguration

No description

type GoogleCloudDataprocClusterConfiguration {
  autoscalingConfiguration: GoogleCloudDataprocClusterAutoscalingConfiguration
  auxiliaryNodeGroups: [GoogleCloudDataprocClusterAuxiliaryNodeGroup!]!
  bucket: String!
  encryptionConfiguration: GoogleCloudDataprocClusterEncryptionConfiguration
  endpointConfiguration: GoogleCloudDataprocClusterEndpointConfiguration
  gceClusterConfiguration: GoogleCloudDataprocClusterGceClusterConfiguration
  gkeClusterConfiguration: GoogleCloudDataprocClusterGkeClusterConfiguration
  initializationActions: [GoogleCloudDataprocClusterInitializationAction!]!
  lifecycleConfiguration: GoogleCloudDataprocClusterLifecycleConfiguration
  masterConfiguration: GoogleCloudDataprocClusterInstanceGroupConfiguration
  metastoreConfiguration: GoogleCloudDataprocClusterMetastoreConfiguration
  secondaryWorkerConfiguration: GoogleCloudDataprocClusterInstanceGroupConfiguration
  securityConfiguration: GoogleCloudDataprocClusterSecurityConfiguration
  softwareConfiguration: GoogleCloudDataprocClusterSoftwareConfiguration
  tempBucket: String!
  workerConfiguration: GoogleCloudDataprocClusterInstanceGroupConfiguration
}

Fields​

GoogleCloudDataprocClusterConfiguration.autoscalingConfiguration ● GoogleCloudDataprocClusterAutoscalingConfiguration object​

Autoscaling config for the policy associated with the cluster

GoogleCloudDataprocClusterConfiguration.auxiliaryNodeGroups ● [GoogleCloudDataprocClusterAuxiliaryNodeGroup!]! non-null object​

The node group settings.

GoogleCloudDataprocClusterConfiguration.bucket ● String! non-null scalar​

A Cloud Storage bucket used to stage job dependencies, config files, and job driver console output

GoogleCloudDataprocClusterConfiguration.encryptionConfiguration ● GoogleCloudDataprocClusterEncryptionConfiguration object​

Encryption settings for the cluster

GoogleCloudDataprocClusterConfiguration.endpointConfiguration ● GoogleCloudDataprocClusterEndpointConfiguration object​

Port/endpoint configuration for this cluster

GoogleCloudDataprocClusterConfiguration.gceClusterConfiguration ● GoogleCloudDataprocClusterGceClusterConfiguration object​

The shared Compute Engine config settings for all instances in a cluster

GoogleCloudDataprocClusterConfiguration.gkeClusterConfiguration ● GoogleCloudDataprocClusterGkeClusterConfiguration object​

BETA. The Kubernetes Engine config for Dataproc clusters deployed to The Kubernetes Engine config for Dataproc clusters deployed to Kubernetes. These config settings are mutually exclusive with Compute Engine-based options, such as gce_cluster_config, master_config, worker_config, secondary_worker_config, and autoscaling_config.

GoogleCloudDataprocClusterConfiguration.initializationActions ● [GoogleCloudDataprocClusterInitializationAction!]! non-null object​

Commands to execute on each node after config is completed

GoogleCloudDataprocClusterConfiguration.lifecycleConfiguration ● GoogleCloudDataprocClusterLifecycleConfiguration object​

Lifecycle setting for the cluster

GoogleCloudDataprocClusterConfiguration.masterConfiguration ● GoogleCloudDataprocClusterInstanceGroupConfiguration object​

The Compute Engine config settings for the cluster's master instance

GoogleCloudDataprocClusterConfiguration.metastoreConfiguration ● GoogleCloudDataprocClusterMetastoreConfiguration object​

Metastore configuration

GoogleCloudDataprocClusterConfiguration.secondaryWorkerConfiguration ● GoogleCloudDataprocClusterInstanceGroupConfiguration object​

The Compute Engine config settings for a cluster's secondary worker instances

GoogleCloudDataprocClusterConfiguration.securityConfiguration ● GoogleCloudDataprocClusterSecurityConfiguration object​

Security settings for the cluster

GoogleCloudDataprocClusterConfiguration.softwareConfiguration ● GoogleCloudDataprocClusterSoftwareConfiguration object​

The config settings for cluster software

GoogleCloudDataprocClusterConfiguration.tempBucket ● String! non-null scalar​

A Cloud Storage bucket used to store ephemeral cluster and jobs data, such as Spark and MapReduce history files

GoogleCloudDataprocClusterConfiguration.workerConfiguration ● GoogleCloudDataprocClusterInstanceGroupConfiguration object​

The Compute Engine config settings for the cluster's worker instances

Member of​

GoogleCloudDataprocCluster object