HDInsight

Welcome! You can use this site to tell the Microsoft HDInsight team what features you would like to see.

Remember that this site is for feature suggestions and ideas…

If you have technical questions, please visit our forums.
If you are looking for tutorials and documentation, please visit our getting started page.

  1. Please create all resources belonging to an HDInsight cluster in the same Resource Group.

    Please create all resources belonging to an HDInsight cluster in one Resource Group.
    When you create an HDInsight cluster into a Vnet, all network resources such as NIC's, Load Balancers and Public IP addresses are created within the resource group that contains the Vnet. Only the HDInsight object itself is created in the original resource group. This is fine for testing but in multi-subscription environments with shared Vnets across resource groups, this is not ideal.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  2. Ability to add Azure Data Lake store after the HDI cluster has been created

    Currently the only way to add ADLS as an additional storage is during the cluster creation time. However, if there is way to add ADLS after the HDI cluster is created, customer can files on ADLS for further analysis

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  3. Need premium Kafka Clusters (S series) in Japan-west region.

    For better Kafka throughput, in Japan West region, we need premium clusters but it is not offered in japan west region. We have checked, all the other regions offer Premium clusters for worker nodes for Kafka. To improve performance it is necessary and hope Premium VMs will be made available in Japan West region asap.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  4. Suggestion regarding the HDInsight

    While creating a HDInsight cluster, if we select the container, which is being used by other cluster it should alert the user then and there, it however raises a flag at the summery page in the end.

    It will be lot simpler for the users if they have a drop-down list of available containers in the storage account which are not in use.

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  5. Why there is no option to restart HDInsight Cluster?

    Why there is no option to restart HDInsight Cluster?

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    3 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  6. Option to create On demand cluster with Data Lake store as storage

    Hi Team,
    I could not find the option of selecting Azure data lake store as the storage medium while creating the on demand HD Insight cluster. I browsed the internet and learnt that On demand cluster + ADLS option is currently not present.
    Would be helpful if that is made available

    Thanks,
    Surya

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  7. Better error descriptions when scaling cluster size

    When trying to scale the number of nodes from 12 to 24, I received a generic error message stating "Failed updating cluster <CLUSTERNAME>, with the detail just saying "Submitting the scale request". When trying to scale the cluster from powershell, I get no output whatsoever - not even an error.

    The problem i was having was that my subnet was out of ip addresses, and would not let us scale any larger because it was out of addresses. The error output, while accurate was not descriptive and resulted in needing to open a help desk ticket to identify the issue.…

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  8. Improve your documentation and Training - stop with the videos

    stop using videos for your training and your documentation.

    Videos
    --> Cannot be searched to be used as a reference
    --> must be followed at the speed of the video rather than at my reading speed
    --> Do not offer hands on tools to play with.

    MSFT Used to provide "time bombed" VMs of configurations for experimentation and scripted training. This needs to come back and the videos need to be used only lightly for demos and PR

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  9. Enable tagging network interfaces at the HDI ARM template level

    Having multiple clusters in the same Resource Group it is impossible to easily determine which network interfaces belong to which cluster. It could be solved by assigning tags to network interfaces.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  10. How to create quickstart cluster using AZ commands

    Please update the article to include the AZ command necessary to create the cluster rather than just using the UI.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  11. How to store Internal log4j2 Logs within the Application that is uploaded and run-ed by Azure HDInsight

    Currently i'm using a HDInsight for my Data Processing Pipeline with multiple nodes required. The application that I upload into Azure HDInsight has its own log4j2 logging within the application itself.
    When I upload this application and run it on the HDInsight Cluster, it works. However, I need to store these log4j2 log results into a possible storage container, which in this case, it is most convenient to use Azure Blob Storage. How do I store it in an Azure Blob Storage with my Application?

    Here's an example of the problem to upload internal log4j2 inside the application, where the…

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  12. How to store Internal log4j2 Logs within the Application that is uploaded and run-ed by Azure HDInsight

    Currently i'm using a HDInsight for my Data Processing Pipeline with multiple nodes required. The application that I upload into Azure HDInsight has its own log4j2 logging within the application itself.
    When I upload this application and run it on the HDInsight Cluster, it works. However, I need to store these log4j2 log results into a possible storage container, which in this case, it is most convenient using Azure Blob Storage. How do I store it in an Azure Blob Storage?

    Here's an example of the problem to upload internal log4j2 inside the application, where the application is uploaded into…

    0 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
2 Next →
  • Don't see your idea?

HDInsight

Categories

Feedback and Knowledge Base