Ron DeFreitas

My feedback

  1. 101 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    5 comments  ·  HDInsight » Platform  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas commented  · 

    Any updates?

    Ron DeFreitas commented  · 

    This is an old suggestion with a lot of votes. Any chance we might see this added to the roadmap? We're about to abandon HDInsight to run Spark on Kubernetes because of the lack of this feature.

    Ron DeFreitas supported this idea  · 
  2. 1,164 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    46 comments  ·  HDInsight » Platform  ·  Flag idea as inappropriate…  ·  Admin →

    [Update] Thanks for your continued feedback on this capability! Rest assured that we are tracking this request closely along with several other platform capabilities our customers have requested. In the meanwhile, you can leverage cluster scaling capability to adjust HDInsight cluster size according to your varying compute needs. Azure Data Factory is another option you can explore for scheduling jobs with automatic creation and deletion of clusters: https://azure.microsoft.com/en-us/documentation/articles/data-factory-data-transformation-activities/

    Adnan Ijaz
    Program Manager
    Microsoft Azure HDInsight

    Ron DeFreitas commented  · 

    Do you guys even read this forum? Nearly three years still with no response other than "we're tracking this".

    Ron DeFreitas commented  · 

    You continue to get votes for this feature with no response in over 2 years... this is creating a hardship for us, as well, and it does not paint Azure in a positive light when I'm trying to sell stakeholders on HDInsight as our technology target.

    Any updates?

  3. 10 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  HDInsight » Workload  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas commented  · 

    You can try something like this when setting up the config for your cluster....

    # Config Bootstrapping
    if($SparkDynamicAllocation)
    {
    $config = $config | Add-AzureRmHDInsightConfigValues -Spark2Defaults @{
    "spark.shuffle.service.enabled"="true";
    "spark.dynamicAllocation.enabled"="true";
    };
    }

  4. 7 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Data Lake  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas shared this idea  · 
  5. 4 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Data Lake  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas shared this idea  · 
  6. 3 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Data Lake  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas supported this idea  · 
  7. 2 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Virtual Machines » Linux  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas shared this idea  · 
  8. 8 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  HDInsight » Platform  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas supported this idea  · 
  9. 36 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  HDInsight » Platform  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas supported this idea  · 
  10. 13 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  SQL Database  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas supported this idea  · 
  11. 15 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  SQL Database  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas supported this idea  · 
  12. 807 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    30 comments  ·  SQL Database  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas supported this idea  · 
  13. 50 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  2 comments  ·  HDInsight » Platform  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas supported this idea  · 
  14. 111 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    5 comments  ·  HDInsight » Platform  ·  Flag idea as inappropriate…  ·  Admin →

    Thanks, This is a common ask from our customers and something we are seriously thinking about. In the meantime you can use Azure Data Factory to “delete” the cluster and you can use persistent metastore using Azure SQL and persistent store like Azure Data Lake Store or Azure Blob which will make it seem like it is “shut down”. Thanks for your feedback. Rashim Gupta (HDInsight Engineering team)

    Ron DeFreitas supported this idea  · 
  15. 11 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Data Lake  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas commented  · 

    The concept of a seekable stream feels like a violation of the mapreduce principals that ADLA follows. A better solution to me is to fix the Apache library to support non-seekable streams via buffering.

  16. 7 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Data Lake  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas commented  · 

    There is already CREATE TABLE IF NOT EXISTS

  17. 11 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Data Lake  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas supported this idea  · 
  18. 19 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  Data Lake  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas supported this idea  · 
  19. 92 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  17 comments  ·  Data Lake  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas commented  · 

    Any updates to built-in parquet or avro support in ADLS/ADLA/U-SQL ?

  20. 102 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  6 comments  ·  SQL Data Warehouse » Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
    Ron DeFreitas supported this idea  · 
← Previous 1

Feedback and Knowledge Base