services | platforms | author |
---|---|---|
data-factory |
dotnet |
spelluru |
In this sample you do the following steps by using .NET SDK:
- Create a data factory.
- Create a linked service to link your Azure Storage account to the data factory.
- Create a dataset that represents input/output data used by the copy activity.
- Create a pipeline with a copy activity that copies data.
- Azure subscription. If you don't have a subscription, you can create a free trial account.
- Azure Storage account. You use the blob storage as source and sink data store. If you don't have an Azure storage account, see the Create a storage account article for steps to create one.
- Create a blob container in Blob Storage, create an input folder in the container, and upload some files to the folder.
- Visual Studio 2015 Update 3, or 2017. The walkthrough in this article uses Visual Studio 2017.
- Download and install Azure .NET SDK.
- Create an application in Azure Active Directory following this instruction. Make note of the following values that you use in later steps: application ID, authentication key, and tenant ID. Assign application to "Contributor" role by following instructions in the same article.
-
Click Tools -> NuGet Package Manager -> Package Manager Console.
-
In the Package Manager Console, run the following commands to install packages:
Install-Package Microsoft.Azure.Management.DataFactory Install-Package Microsoft.Azure.Management.ResourceManager Install-Package Microsoft.IdentityModel.Clients.ActiveDirectory
-
Set values for variables in the Program.cs file:
string tenantID = "<tenant ID>"; string applicationId = "<application ID>"; string authenticationKey = "<application key>"; string subscriptionId = "<subscription ID>"; string resourceGroup = "<resource group name>"; string region = "East US"; string dataFactoryName = "<data factory name>"; string storageAccount = "<azure storage account name>"; string storageKey = "<azure storage account key>"; string inputBlobPath = "<blobcontainer/inputfolder>"; string outputBlobPath = "<blobcontainer/outputfolder>";
-
Add some text files to the input folder in the Azure Blob Storage.
-
Build the project and run the program.
-
Verify that the files are copied to the destination location in the Blob Storage.
For step-by-steps instructions to create this sample from scratch, see Quickstart: create a data factory and pipeline using .NET SDK.