Azure HDInsight provides 100 percent HDFS functionality using Azure Blob storage under the covers. So, to load data to the cluster, we can load data straight to Azure Blob storage without the need of the HDInsight cluster, thereby, making this more cost effective. In this section, we will see how to load data to Azure Blob using Azure PowerShell.
To load the data to Azure Blob storage from a local filesystem, we will perform the following steps:
Open Azure PowerShell using the shortcut on your desktop and type in the
Get-AzurePublishSettingsFilecommand. This will open themanage.windowsazure.comweb page and download a.publishsettingsfile.Next, type in the
Import-AzurePublishSettingsFilecommand with thepublishsettingsfile to import the management certificate.If you have multiple Azure subscriptions, you will need to use the
Set-AzureSubscriptioncommand to the context of PowerShell:Set-AzureSubscription -SubscriptionName "Pay...