Support for Dynamic Content with pagination rule in Rest source while Copy Data activity
I'm using pagination rule in copy data activity from rest endpoint to blob storage.
I have applied pagination rule with dynamic value like this:
AbsoluteUrl = @replace('$.nextLink','oldbaseurl','newbaseurl')
But it is still accessing the oldbaseurl which is I'm getting in response, doesn't replace it with new through function.
Error in data factory:
ErrorCode=UserErrorFailToReadFromRestResource,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=An error occurred while sending the request.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.Http.HttpRequestException,Message=An error occurred while sending the request.,Source=mscorlib,''Type=System.Net.WebException,Message=Unable to connect to the remote server,Source=System,''Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond xx.xx.xx.xx:443,Source=System,'", "failureType": "UserError", "target": "cdr", "details":  }
Please provide this feature to use jsonpath variable in dynamic content function of data factory
This is definitely a required feature. Copy activity already has the json element and dynamic content. Allowing to use them together will be really helpful to support other custom paging scenarios.