How can we improve Microsoft Azure SQL Data Warehouse ?

Workflow capability within Azure Data warehouse to run parallel queries.

To maximise the parallel execution and MPP architecture, it will be great to have a workflow capability that will allow users to run queries in parallel against a defined Resource Class.
I appreciate this could be against the SQL engine design but looking at the architecture we might be able to do something like this

workflow-Parallel (ResourceClassUser = XlargeRCuser, OptionalAllocMaxMemory = 0.5)
{

Exec SP_Tranform1;
Exec SP_Tranform2;
Exec SP_Tranform3;
Exec SP_Tranform4;
}

where 4 sprocs will run in parallel with defined RC and max memory allocation in percentage/ratio to the total max available for the RC, half in this case.

Thanks
Sherin Mathew

4 votes
Sign in
(thinking…)
Sign in with: Microsoft
Signed in as (Sign out)

We’ll send you updates on this idea

Sherin_DataArtist shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

0 comments

Sign in
(thinking…)
Sign in with: Microsoft
Signed in as (Sign out)
Submitting...

Feedback and Knowledge Base