AWS Amazon EMR Instance Fleet
This page shows how to write Terraform and CloudFormation for Amazon EMR Instance Fleet and write them securely.
aws_emr_instance_fleet (Terraform)
The Instance Fleet in Amazon EMR can be configured in Terraform with the resource name aws_emr_instance_fleet. The following sections describe how to use the resource and its parameters.
Example Usage from GitHub
An example could not be found in GitHub.
Parameters
-
cluster_idrequired - string -
idoptional computed - string -
nameoptional - string -
provisioned_on_demand_capacityoptional computed - number -
provisioned_spot_capacityoptional computed - number -
target_on_demand_capacityoptional - number -
target_spot_capacityoptional - number -
instance_type_configsset block-
bid_priceoptional - string -
bid_price_as_percentage_of_on_demand_priceoptional - number -
instance_typerequired - string -
weighted_capacityoptional - number -
configurationsset block-
classificationoptional - string -
propertiesoptional - map from string to string
-
-
ebs_configset block-
iopsoptional - number -
sizerequired - number -
typerequired - string -
volumes_per_instanceoptional - number
-
-
-
launch_specificationslist block-
on_demand_specificationlist block-
allocation_strategyrequired - string
-
-
spot_specificationlist block-
allocation_strategyrequired - string -
block_duration_minutesoptional - number -
timeout_actionrequired - string -
timeout_duration_minutesrequired - number
-
-
Explanation in Terraform Registry
Provides an Elastic MapReduce Cluster Instance Fleet configuration. See Amazon Elastic MapReduce Documentation for more information.
NOTE: At this time, Instance Fleets cannot be destroyed through the API nor web interface. Instance Fleets are destroyed when the EMR Cluster is destroyed. Terraform will resize any Instance Fleet to zero when destroying the resource.
AWS::EMR::InstanceFleetConfig (CloudFormation)
The InstanceFleetConfig in EMR can be configured in CloudFormation with the resource name AWS::EMR::InstanceFleetConfig. The following sections describe 10 examples of how to use the resource and its parameters.
Example Usage from GitHub
Type: AWS::EMR::InstanceFleetConfig
Description: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-elasticmapreduce-instancefleetconfig.html
Properties:
ClusterId: !Ref 'ClusterId'
InstanceFleetType: !Ref 'InstanceFleetType'
Type: AWS::EMR::InstanceFleetConfig
Description: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-elasticmapreduce-instancefleetconfig.html
Properties:
ClusterId: !Ref 'ClusterId'
InstanceFleetType: !Ref 'InstanceFleetType'
Type: AWS::EMR::InstanceFleetConfig
Description: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-elasticmapreduce-instancefleetconfig.html
Properties:
ClusterId: !Ref 'ClusterId'
InstanceFleetType: !Ref 'InstanceFleetType'
Type: AWS::EMR::InstanceFleetConfig
Description: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-elasticmapreduce-instancefleetconfig.html
Properties:
ClusterId: !Ref 'ClusterId'
InstanceFleetType: !Ref 'InstanceFleetType'
Type: AWS::EMR::InstanceFleetConfig
Description: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-elasticmapreduce-instancefleetconfig.html
Properties:
ClusterId: !Ref 'ClusterId'
InstanceFleetType: !Ref 'InstanceFleetType'
"AWS::EMR::InstanceFleetConfig.Configuration": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticmapreduce-instancefleetconfig-configuration.html",
"Properties": {
"Classification": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticmapreduce-instancefleetconfig-configuration.html#cfn-elasticmapreduce-instancefleetconfig-configuration-classification",
"PrimitiveType": "String",
"AWS::EMR::InstanceFleetConfig.Configuration": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticmapreduce-instancefleetconfig-configuration.html",
"Properties": {
"Classification": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticmapreduce-instancefleetconfig-configuration.html#cfn-elasticmapreduce-instancefleetconfig-configuration-classification",
"PrimitiveType": "String",
"AWS::EMR::InstanceFleetConfig.Configuration": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticmapreduce-instancefleetconfig-configuration.html",
"Properties": {
"Classification": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticmapreduce-instancefleetconfig-configuration.html#cfn-elasticmapreduce-instancefleetconfig-configuration-classification",
"PrimitiveType": "String",
"AWS::EMR::InstanceFleetConfig.Configuration": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticmapreduce-instancefleetconfig-configuration.html",
"Properties": {
"Classification": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticmapreduce-instancefleetconfig-configuration.html#cfn-elasticmapreduce-instancefleetconfig-configuration-classification",
"PrimitiveType": "String",
"AWS::EMR::InstanceFleetConfig.Configuration": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticmapreduce-instancefleetconfig-configuration.html",
"Properties": {
"Classification": {
"Documentation": "http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticmapreduce-instancefleetconfig-configuration.html#cfn-elasticmapreduce-instancefleetconfig-configuration-classification",
"PrimitiveType": "String",
Parameters
-
ClusterIdrequired - String -
InstanceFleetTyperequired - String -
InstanceTypeConfigsoptional - List of InstanceTypeConfig -
LaunchSpecificationsoptional - InstanceFleetProvisioningSpecifications -
Nameoptional - String -
TargetOnDemandCapacityoptional - Integer -
TargetSpotCapacityoptional - Integer
Explanation in CloudFormation Registry
Use
InstanceFleetConfigto define instance fleets for an EMR cluster. A cluster can not use both instance fleets and instance groups. For more information, see Configure Instance Fleets in the Amazon EMR Management Guide. Note The instance fleet configuration is available only in Amazon EMR versions 4.0 and later, excluding 5.
x versions.
Frequently asked questions
What is AWS Amazon EMR Instance Fleet?
AWS Amazon EMR Instance Fleet is a resource for Amazon EMR of Amazon Web Service. Settings can be wrote in Terraform and CloudFormation.
Where can I find the example code for the AWS Amazon EMR Instance Fleet?
For CloudFormation, the awslabs/aws-service-catalog-products, awslabs/aws-service-catalog-products and awslabs/aws-service-catalog-products source code examples are useful. See the CloudFormation Example section for further details.