How can we improve Microsoft Azure SQL Data Warehouse ?

Ignore update when there are no changes

In DW project, usually there are scenarios where full data load of dimension happens. Even if there are no attributes changes, the timestamp of the records get change and that causes cascading impact in the DW system, wherein dependent facts and dimension are full processed. This is very resource intensive task and causes entire DW facts recreation.

To avoid this, it would be good to have a T-SQL syntax wherein it checks the required attributes between the incoming record and the destination and updates if and only if the attribute is change. eg:

UPDATE Emp UPDATE WHEN Name, DOB CHANGED
SET NAme = I.Name
,DOB= I.DOB
,UpdateDate=GETDATE()
FROM EMP E
INNER JOIN EmpInput I ON E.EmpId=I.EmpID

2 votes
Sign in
(thinking…)
Sign in with: Microsoft
Signed in as (Sign out)

We’ll send you updates on this idea

Srikant Jahagirdar shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

0 comments

Sign in
(thinking…)
Sign in with: Microsoft
Signed in as (Sign out)
Submitting...

Feedback and Knowledge Base