In copy activity from cosmos to cosmos, we should have an option to create target container on demand. The data flow has the option to create container but it doesn't copy the data as is.. It drops null fields which in our case a big impact in data.

When copying data from Salesforce, we can specify SOQL query to retrieve data from salesforce in data factory. However, we fails when we have dupicate column names in the same query due to SOQL master-detail relationship. As the query can retrieve data successfully in Salesforce, we expect we can have the same behavior as salesforce does in data factory in the future.

Sample Query:select account.Id , (select contact.Name from contacts) from account
where account.name = 'ABC'

Error: ErrorCode=TypeConversionDuplicateColumnName,Exception occurred in type conversion： There are duplicate column names 'Id' in source..

For Data Factories connect to GitHub, provide other ways to log in. For example out-of-band authentication could be performed using OAuth Device Code flow or logging in with a GitHub Personal Access Token. For setups where your account to manage Data Factory is not the same as the account you use with GitHub is not the same, it is currently very difficult to connect the two services. Especially in high security environments where Conditional Access etc. impose further restrictions on accounts.

The existing SFTP connector in Azure data factory is not supporting multi-factor authentication. The connector supports either password based authentication or key based authentication. Enterprises are moving towards multi-factor authentication requiring both key and password for SFTP. This is a must have feature given the information security focus.

Currently there is no Dynamics 365 connector availability in Data flows in Data factory. If we have this option this would help us in creating data flows for the incremental movement of Dynamics 365 data from one org to another org. This would help a lot users in using different XRM tools/SSIS for portal content migration and master data migration.

It would help a lot of Dynamics systems to ease the process.

I would like to be able to set an Azure Service Bus queue or topic as a data source in the Data Factory pipeline.

This would allow me to directly ingest message events into my pipeline and transform the message data.

If I could keep the connection open between the pipeline and the service bus, then the pipeline could run every time a new message is available.

Linked Service Snowflake OAuth
Add the ability to connect to Snowflake using not only basic authentication, but also with OAuth (App registration/managed identities).

Will be useful to have GitLab integration in Azure Data Factory along with GitHub and Azure Repos as it's one of the most popular tools

Now, somebody must get to the dev ADF, open the master branch, and hit “Publish” for the changes to get the “Adf_publish” updated.

Automating “Publish” on the master branch is necessary for improving efficiency and saving more time.

Customer would like to split the cost of the pipeline of a same data factory But from the different projects.

Like customer is having same pipeline but those are used in different projects with the different triggers. So difference here in 2 projects is trigger only.

So their concern here is will it possible to analyze the cost of the pipeline which ran by each project trigger.

Working with ADF is good experience but it can be more user friendly if ADF can support Dark mode because all white is kind of distracting.

The Wrangling Data Flow - Power Query doesn't have support for Service principal authentication for ADLS Gen2 data sources. Only the Account Key authentication type can be used to connect to a dataset from ADLS Gen2 storage. It should not be a product limitation.

Hi Team,

We do have hundreds of triggers and it will be growing, As part of the BAU support if we need to disable the triggers and there is no option to select All and disable the trigger.

Feature to be added - Can you add a SelectAll option and disable and enable button on the trigger section to do that in one shot.

Thanks
Jawahar

The current version of this connector treats any SP List columns that allow multiple values as a "complex type". These are not supported in the connector, so the data in those columns are not available.

Please add parameters to Microsoft Access Linked Service in order to parameterize the connection string, e.g: this is to connect to different access files in the same folder

The default timeout for Copy Activities in Azure Data Factory is 7 days.
We are used to set this property individually to a much lower value for every Copy Activity we use.

More generally speaking it would be great to be able to configure Default Values per Activity Type to adjust those values to local procedures.

This way when developing new pipelines not every property would have been needed to be set individually every time again and again.

So please provide Adjustable, Per Activity - Default Property Values.