Improvement on FOR EACH Activity
Since FOR EACH activity in ADF uses Bucketing approach, we could see there are some delay in execution of pipelines.
Consider we have 40 objects to be iterated with 10 batch count, ADF split these 40 objects into 10 buckets having 4 objects in each bucket.
Though buckets running in parallel, objects in each bucket are executed in sequentially. There are some scenario where one object runs more than 10 times than other objects, in this case consider if this object is placed as 1st object in Bucket1, until this object completes other objects in bucket will not be started though other objects in other buckets completed in lesser time.
Apart from this point, I would like to suggest to make Batch Count value for FOR EACH activity to be parameterized so that it would be more beneficial so user can pass it based on his requirement instead of static value(hardcoded value)