none
error while Creating a HDInsight Cluster with default storage Data Lake store using automation Run-book RRS feed

  • Question

  • I try to create an HDInsight with DataLake store in Automation Runbook but I face an issue.

    I already create a Data lake store and certificate in AAD(I have an ObectID and ApplicationID) 

    I store the certificate in asset and make it as exportable

    My Script:

    # Sign in
    $azureUser = "User name" #Provide Microsoft account username
    $azurePSWD = $password = ConvertTo-SecureString "Password" -AsPlainText -Force #Provide Microsoft Account Password
    $azureCredential = New-Object System.Management.Automation.PSCredential ($azureUser, $azurePSWD)
    Login-AzureRmAccount -Credential $azureCredential
    # Select the subscription to use
    $subscriptionID = "SubscriptionID" # Provide Azure SubscriptionID
    Select-AzureRmSubscription -SubscriptionId $subscriptionID
    ###########################################
    # Create an HDInsight Cluster
    ###########################################
    # Cluster Variables
    $resourceGroupName = "Resource Group Name" # Provide Resource Group Name
    $storageAccountName = "Storage Account Name" # Provide Storage Account Name
    $storageRootPath = "path" # E.g. /clusters/hdiadlcluster
    $clusterName = "cluster name"
    $clusterNodes = 1
    $clusterUser = "" # Provide Cluster Username
    $clusterSSHUser = "" # Provide SSH Username
    $clusterPSWD = ConvertTo-SecureString "password" -AsPlainText -Force # Provide password to use for cluster and ssh if the same
    $clusterCredential = New-Object System.Management.Automation.PSCredential ($clusterUser, $clusterPSWD)
    $sshCredential = New-Object System.Management.Automation.PSCredential ($clusterSSHUser, $clusterPSWD)
    $clusterType = "Hadoop"
    $clusterOS = "Linux"
    $clusterNodeSize = "Standard_A3"
    $location = "Central US"
    ####################################
    # DataLake store credential
    ####################################
    $tenantID = (Get-AzureRmContext).Tenant.TenantId
    Write-Output $tenantid
    $CertPath = "C:\\mycertificate.pfx"
    $cert = Get-AutomationCertificate -Name 'mycertificate'
    Write-Output $cert
    $certPassword = "password"
    $PfxCert = $cert.Export("pfx",$certPassword)
    Set-Content -Value $PfxCert -Path $CertPath -Force -Encoding Byte | Write-Verbose
    dir $CertPath
    $applicationid = "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"
    $servicePrincipalobjectId = "xxxxxxxxxxxxxxxxxxxxxxxxxxxxx"

    New-AzureRmHDInsightCluster -ClusterName $clusterName -ResourceGroupName $resourceGroupName -HttpCredential $clusterCredential -Location $location -DefaultStorageAccountType AzureDataLakeStore -DefaultStorageAccountName "sfcsdls.azuredatalakestore.net" -DefaultStorageRootPath $storageRootPath -ClusterSizeInNodes $clusterNodes -ClusterType $clusterType -OSType $clusterOS -Version "3.6" -SshCredential $sshCredential -HeadNodeSize $clusterNodeSize -WorkerNodeSize $clusterNodeSize -ObjectId $servicePrincipalobjectId -CertificateFilePath $cert -CertificatePassword $certPassword -AadTenantId $tenantID

    ################################

    The OUTPUT Error:

    New-AzureRmHDInsightCluster : Operation returned an invalid status code 'NotFound'
    At line:66 char:1
    + New-AzureRmHDInsightCluster -ClusterName $clusterName -ResourceGroupN ...
    + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
        + CategoryInfo          : CloseError: (:) [New-AzureRmHDInsightCluster], GraphErrorException
        + FullyQualifiedErrorId : Microsoft.Azure.Commands.HDInsight.NewAzureHDInsightClusterCommand
    
    Friday, February 16, 2018 8:20 AM

Answers