Azure Data Factory Dataset HTTP
This page shows how to write Terraform and Azure Resource Manager for Data Factory Dataset HTTP and write them securely.
azurerm_data_factory_dataset_http (Terraform)
The Dataset HTTP in Data Factory can be configured in Terraform with the resource name azurerm_data_factory_dataset_http
. The following sections describe 8 examples of how to use the resource and its parameters.
Example Usage from GitHub
resource "azurerm_data_factory_dataset_http" "QuickCloudPOC"{
name="QuickCloudPOCDataSet"
resource_group_name = azurerm_resource_group.QuickCloudPOC.name
data_factory_name = azurerm_data_factory.QuickCloudPOC.name
linked_service_name = azurerm_data_factory_linked_service_web.QuickCloudPOC.name
relative_url = "http://www.bing.com"
resource "azurerm_data_factory_dataset_http" "QuickCloudPOCsADF" {
name = "QuickCloudPOCsADFDataSet"
resource_group_name = azurerm_resource_group.QuickCloudPOCsADF.name
data_factory_name = azurerm_data_factory.QuickCloudPOCsADF.name
linked_service_name = azurerm_data_factory_linked_service_web.QuickCloudPOCsADF.name
resource "azurerm_data_factory_dataset_http" "QuickCloudPOCsADF" {
name = "QuickCloudPOCsADFDataSet"
resource_group_name = azurerm_resource_group.QuickCloudPOCsADF.name
data_factory_name = azurerm_data_factory.QuickCloudPOCsADF.name
linked_service_name = azurerm_data_factory_linked_service_web.QuickCloudPOCsADF.name
resource "azurerm_data_factory_dataset_http" "dataset" {
name = var.name
resource_group_name = var.resource_group_name
data_factory_name = var.data_factory_name
linked_service_name = var.linked_service_name
folder = try(var.folder, null)
resource "azurerm_data_factory_dataset_http" "dataset" {
name = var.name
resource_group_name = var.resource_group_name
data_factory_name = var.data_factory_name
linked_service_name = var.linked_service_name
folder = try(var.folder, null)
resource "azurerm_data_factory_dataset_http" "QuickCloudPOCsADF" {
name = "QuickCloudPOCsADFDataSet"
resource_group_name = azurerm_resource_group.QuickCloudPOCsADF.name
data_factory_name = azurerm_data_factory.QuickCloudPOCsADF.name
linked_service_name = azurerm_data_factory_linked_service_web.QuickCloudPOCsADF.name
resource "azurerm_data_factory_dataset_http" "dataset" {
name = var.name
resource_group_name = var.resource_group_name
data_factory_name = var.data_factory_name
linked_service_name = var.linked_service_name
folder = try(var.folder, null)
resource "azurerm_data_factory_dataset_http" "dataset" {
name = azurecaf_name.dataset.name
resource_group_name = var.resource_group_name
data_factory_name = var.data_factory_name
linked_service_name = var.linked_service_name
folder = try(var.settings.folder, null)
Parameters
-
additional_properties
optional - map from string to string -
annotations
optional - list of string -
data_factory_name
required - string -
description
optional - string -
folder
optional - string -
id
optional computed - string -
linked_service_name
required - string -
name
required - string -
parameters
optional - map from string to string -
relative_url
optional - string -
request_body
optional - string -
request_method
optional - string -
resource_group_name
required - string -
schema_column
list block-
description
optional - string -
name
required - string -
type
optional - string
-
-
timeouts
single block
Explanation in Terraform Registry
Manages an Azure HTTP Dataset inside an Azure Data Factory.
Tips: Best Practices for The Other Azure Data Factory Resources
In addition to the azurerm_data_factory, Azure Data Factory has the other resources that should be configured for security reasons. Please check some examples of those resources and precautions.
azurerm_data_factory
Ensure to disable public access
It is better to disable public access for Data Factory, which is enabled as default.
Microsoft.DataFactory/factories/datasets (Azure Resource Manager)
The factories/datasets in Microsoft.DataFactory can be configured in Azure Resource Manager with the resource name Microsoft.DataFactory/factories/datasets
. The following sections describe how to use the resource and its parameters.
Example Usage from GitHub
An example could not be found in GitHub.
Parameters
apiVersion
required - stringname
required - stringThe dataset name.
properties
requiredadditionalProperties
optional - objectUnmatched properties from the message are deserialized this collection
annotations
optional - arrayList of tags that can be used for describing the Dataset.
description
optional - stringDataset description.
folder
optionalname
optional - stringThe name of the folder that this Dataset is in.
linkedServiceName
requiredparameters
optional - objectAn object mapping parameter names to argument values.
referenceName
required - stringReference LinkedService name.
type
required - stringLinked service reference type.
parameters
optional - undefinedDefinition of all parameters for an entity.
schema
optional - objectColumns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure
optional - objectColumns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type
required - string
Frequently asked questions
What is Azure Data Factory Dataset HTTP?
Azure Data Factory Dataset HTTP is a resource for Data Factory of Microsoft Azure. Settings can be wrote in Terraform.
Where can I find the example code for the Azure Data Factory Dataset HTTP?
For Terraform, the pachpolkalyani/ADF_Demo_1, RekhuGopal/PythonHacks and seeewhy/PythonHacks source code examples are useful. See the Terraform Example section for further details.