How can we improve Microsoft Azure Data Lake?

Call USQL Code inside SSIS and Create USQL Framework Library like .NET library

- There are millions of SSIS developers, there are few USQL developers now, how do we lure those SSIS developers into ADL USQL by leveraging their familiar environment (SSIS)? the answer is we let those SSIS developers call USQL inside SSIS. the USQL code would run in ADLA so it is performant, SSIS just initiate the call that's all.
Also, since there are so many ways to clean data, we should really write cleaning routines in USQL - create a library of cleaning routines and most frequently used function/code/snippets/templates and call it USQL Framework (just like .NET framework). In fact, the USQL framework might leverage .NET framework as well (wrapping USQL around .NET functions for example).
- the benefit is that it helps ETL developers get up and running quickly to clean data that they dump into ADLStore and ADLA tables. Over time, we can make this USQL framework library a community contribution just like Power BI custom visuals. Even the documentation for these library USQL functions can be managed by the community.

22 votes
Sign in
(thinking…)
Sign in with: Microsoft
Signed in as (Sign out)

We’ll send you updates on this idea

Binh Cao shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

0 comments

Sign in
(thinking…)
Sign in with: Microsoft
Signed in as (Sign out)
Submitting...

Feedback and Knowledge Base