Provide method to programmatically execute an ADF pipeline on-demand
Now that we have Azure functions available that can help make batch data processing more real-time, it would be great to be able to programmatically invoke the workflow component of ADF, for immediate execution of the pipeline.
You can do this in ADF V2 using any of the programmatic interfaces: PSH command, .NET SDK, Python SDK, and REST API.
clinton mccutcheon commented
This is already achievable via the REST API
I didn't see any requests for either Kafka or Event Hub as a data source. That will enable use of ADF as a real-time data processing pipeline in addition to Batch.
Shahid Iqbal commented
This would be extremely useful - event based triggers would make ADF so much more useful.
arief bavan commented
This will be really useful for carrying out workflows on demand
Venks Mantha commented