Add ".update" management command to allow correct wrong ingested data
When data gets wrongly ingested into ADX, it very hard to correct this data afterwards. -> I know ADX is a append-only store.
Let's say a sending machine had issues with daylight saving time and all data is shifted and after some days, it gets recognized and the machine is sending correct values. There is small slice of data, which needs to be aligned.
Or some properties where wrongly set over some time. Same as above.
Currently, we use the ".purge" command and re-ingest the data, which leads to a wrong "ingestion-time". Another option is completely re-ingest the data into new table and swap it afterwards.
To make things short: An ".update" command would really be helpful, even it's an expensive operation, but the logic would be encapsulated and handled by ADX.