Update: Microsoft will be moving away from UserVoice sites on a product-by-product basis throughout the 2021 calendar year. We will leverage 1st party solutions for customer feedback. Learn more here.

HDInsight

Welcome! You can use this site to tell the Microsoft HDInsight team what features you would like to see.

Remember that this site is for feature suggestions and ideas…

If you have technical questions, please visit our forums.
If you are looking for tutorials and documentation, please visit our getting started page.

  1. Vastly improve debugging return messages when creating HDInsight Kafka Clusters. The current "Unexpected error" is really hard to debug.

    Over the last 2 months, I've created multiple HDInsight based Kafka clusters. The ability to debug the creation process - On a scale of 1-10, I would give HDInsight a solid 0.

    The most seen error messages are:
    - Unexpected error
    - Conflict
    - Error

    When looking into the details, You find the detailed JSON response body. With the awesome added event timestamps. Sorry to say - but that does not help me figure out the cause.

    4 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  2. Change VM size of Worker, Head and Zookeeper

    Change VM size of Worker, Head and Zookeeper from Azure Portal. Today this option are locked, if I need change the vm size, I need to deploy a new cluster.

    4 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  3. Please create all resources belonging to an HDInsight cluster in the same Resource Group.

    Please create all resources belonging to an HDInsight cluster in one Resource Group.
    When you create an HDInsight cluster into a Vnet, all network resources such as NIC's, Load Balancers and Public IP addresses are created within the resource group that contains the Vnet. Only the HDInsight object itself is created in the original resource group. This is fine for testing but in multi-subscription environments with shared Vnets across resource groups, this is not ideal.

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  4. Need premium Kafka Clusters (S series) in Japan-west region.

    For better Kafka throughput, in Japan West region, we need premium clusters but it is not offered in japan west region. We have checked, all the other regions offer Premium clusters for worker nodes for Kafka. To improve performance it is necessary and hope Premium VMs will be made available in Japan West region asap.

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  5. Ability to add Azure Data Lake store after the HDI cluster has been created

    Currently the only way to add ADLS as an additional storage is during the cluster creation time. However, if there is way to add ADLS after the HDI cluster is created, customer can files on ADLS for further analysis

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  6. Better error descriptions when scaling cluster size

    When trying to scale the number of nodes from 12 to 24, I received a generic error message stating "Failed updating cluster <CLUSTERNAME>, with the detail just saying "Submitting the scale request". When trying to scale the cluster from powershell, I get no output whatsoever - not even an error.

    The problem i was having was that my subnet was out of ip addresses, and would not let us scale any larger because it was out of addresses. The error output, while accurate was not descriptive and resulted in needing to open a help desk ticket to identify the issue.…

    2 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  7. Improve your documentation and Training - stop with the videos

    stop using videos for your training and your documentation.

    Videos
    --> Cannot be searched to be used as a reference
    --> must be followed at the speed of the video rather than at my reading speed
    --> Do not offer hands on tools to play with.

    MSFT Used to provide "time bombed" VMs of configurations for experimentation and scripted training. This needs to come back and the videos need to be used only lightly for demos and PR

    2 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  8. Suggestion regarding the HDInsight

    While creating a HDInsight cluster, if we select the container, which is being used by other cluster it should alert the user then and there, it however raises a flag at the summery page in the end.

    It will be lot simpler for the users if they have a drop-down list of available containers in the storage account which are not in use.

    2 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  9. Why there is no option to restart HDInsight Cluster?

    Why there is no option to restart HDInsight Cluster?

    2 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    3 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  10. Option to create On demand cluster with Data Lake store as storage

    Hi Team,
    I could not find the option of selecting Azure data lake store as the storage medium while creating the on demand HD Insight cluster. I browsed the internet and learnt that On demand cluster + ADLS option is currently not present.
    Would be helpful if that is made available

    Thanks,
    Surya

    2 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  11. Enable tagging network interfaces at the HDI ARM template level

    Having multiple clusters in the same Resource Group it is impossible to easily determine which network interfaces belong to which cluster. It could be solved by assigning tags to network interfaces.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  12. How to create quickstart cluster using AZ commands

    Please update the article to include the AZ command necessary to create the cluster rather than just using the UI.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  13. How to store Internal log4j2 Logs within the Application that is uploaded and run-ed by Azure HDInsight

    Currently i'm using a HDInsight for my Data Processing Pipeline with multiple nodes required. The application that I upload into Azure HDInsight has its own log4j2 logging within the application itself.
    When I upload this application and run it on the HDInsight Cluster, it works. However, I need to store these log4j2 log results into a possible storage container, which in this case, it is most convenient to use Azure Blob Storage. How do I store it in an Azure Blob Storage with my Application?

    Here's an example of the problem to upload internal log4j2 inside the application, where the…

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  14. Need filesviews for the ambari

    We are unable to create the files view on ambari

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  15. Setup a Monitoring in Database usage

    Recently we had this issue whereas our Ooziee jobs stopped running because of a quota limit error in the Database. We'd like to recommend an idea of how this can be prevented by placing a monitoring alert if the threshold set reached. This would help to minimize the impact from the cloud tenant perspective since the cloud provider has visibility on what's happening in the backend.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  16. How to store Internal log4j2 Logs within the Application that is uploaded and run-ed by Azure HDInsight

    Currently i'm using a HDInsight for my Data Processing Pipeline with multiple nodes required. The application that I upload into Azure HDInsight has its own log4j2 logging within the application itself.
    When I upload this application and run it on the HDInsight Cluster, it works. However, I need to store these log4j2 log results into a possible storage container, which in this case, it is most convenient using Azure Blob Storage. How do I store it in an Azure Blob Storage?

    Here's an example of the problem to upload internal log4j2 inside the application, where the application is uploaded into…

    0 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  17. Setup a Monitoring in Database usage

    Recently we had this issue whereas our Ooziee jobs stopped running because of a quota limit error in the Database. We'd like to recommend an idea of how this can be prevented by placing a monitoring alert if the threshold set reached. This would help to minimize the impact from the cloud tenant perspective since the cloud provider has visibility on what's happening in the backend.

    0 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
2 Next →
  • Don't see your idea?

HDInsight

Categories

Feedback and Knowledge Base