Azure Data Factory - Restart an entire pipeline
Currently in Azure Data Factory, there is no functionality to restart an entire Pipeline. If we need to refresh a dataset in Azure, all associated activities in the pipeline will have to be selected and run separately. Can we have an option where we could run the entire pipeline if required.
Mandal, Sujalkumar commented
We have a master pipeline which checks for certain parameters in a until loop before the master pipeline can start subsequent activities. The loop has a wait activity as well inside so that the checking happens at a defined interval. Now if for some reason any activity which is later to this loop fails and we restart the pipeline from the point of failure, all the instances of the wait activity runs again and the restart from the point of failure takes as much time as it took in the first run.
Until(Wait 5 mins)-> Activity A -> Activity B
If activity A fails and we restart it from Activity A, the until loop executes all the instances of wait activity and they don't get skipped.
Dennis D commented
Just to try and help: I have a pipeline above the pipeline that i need to run. So if something failes, it starts again.
Please can you combine this request with the following requests as there are actually almost 300 votes in total for this functionality or similar: