We need to use bitbucket for a project. We are mirroring our azure devops repo with the pipelines to bitbucket. It would be easier if there was integration with bitbucket.

Some customers have the necessity to extract information from Google Analytics in order to create a data lake or sql dw to gather marketing insights mixing another kind of data.

Now we have some custom SSIS packages that are paid or developing some custom code.

Or if it is not possible in Azure Data Factory, could have anoter way to extract this data in native connector in Azure … maybe Logic Apps

In ETL/ELT scenario's we generate ADF pipelines per entity that we ingest. We give each pipeline the name of the entity that we ingest. In some cases this can be a long name. We also generate a orchestration pipeline that executes all individual pipelines per table. However activity names have a relatively short limit (55 characters), this complicates the generation of the said pipeline. Please increase the allowed length of the activity name.

Allow resizing of Activities in the designer, or add an Annotation element so we can mark up the workflow.

The current display does not show enough characters to differentiate similarly-named Activities. Many teams use prefixes or suffixes to name things, and this designer needs to enable us do resize Activities.

Data Factory version 2 currently supports Web Activities with a default timeout of 1 minute:

https://docs.microsoft.com/en-us/azure/data-factory/control-flow-web-activity

"REST endpoints that the web activity invokes must return a response of type JSON. The activity will timeout at 1 minute with an error if it does not receive a response from the endpoint."

Please add ability to specify a longer timeout period for complex tasks.

Add Azure Stack capabilities for blob storage transfers /integration. This moment only Azure integrations are possible. Even when trying SAS connection strings

Currently, I can run a ForEach activity with batchCount 3 to allow processing 3 inner activities in parallel. However, when one of the inner activities fail and need to e.g. wait 10 minutes to retry, only 2 inner activities are performed in parallel.

It would be great if one could simply put the activities waiting to retry "to the side" and allow for all 3 "threads" to work during the retry interval. As I understand, the retryIntervalInSeconds is anyway only an "at the earliest" value.

Hi, inside ADF it should be very useful to have a Google Analytics connector to use as a data source for a data pipeline (e.g. for the copy task). Thanks

It is currently not possible to pull down docker images and run those as tasks through Data Factory, even though this is already possible through Batch itself.

https://github.com/MicrosoftDocs/azure-docs/issues/16473

It is not currently possible to identify the IP Address of the DF, which you need for firewall rules, including Azure SQL Server firewall....

Currently Visual Studio 2017 does not support Azure Data Factory projects.

Despite the Azure SDK now being included in VS2017 with all other services the ADF project files aren't.

Can you please include this feature so developers can upgrade from VS2015?

Thanks

ADF v2 - Rerun from the point of failure OR Ability to rerun activities

When we chain multiple child pipelines using a Master pipeline and if the master pipeline fails - There should be an option to start the master pipeline from the point of failure.

Example Master pipeline 1 - 2 - 3 - 4, there are 4 Execute Pipeline activities chained in the Master pipeline - for some reason 3 fails. Assume the issue fixed. When we rerun from Monitor portal the pipeline should execute from 3 and not from 1.

Parametrize PostgreSQL linked services with dynamic contents, as it is already done for SQL Server, ORACLE [1]

we need to address 50 PostgreSQL servers having the same data structure. How can we dynamically choose the server ?

[1] https://docs.microsoft.com/en-us/azure/data-factory/parameterize-linked-services

My source gives me a file that is compressed and packaged as .tar.gz. Currently Azure data factory can only handle the decompression step, and not unpacking the tar file. I think will have to write a custom activity to handle this now.

Support running the ADF Self-hosted IR in Service Fabric clusters. This will require support for non Windows Service hosting modes. Being able to run the Self-hosted IR from command line is all that is required.

When a Web Activity calls an API that returns a JSON array as the response we get an error that says "Response Content is not a valid JObject". Please support JSON arrays as the top level of the response.

Currently there does not seem to be any way to do this. The service I want to connect to has different versions deployed to different environments.