Update: Microsoft will be moving away from UserVoice sites on a product-by-product basis throughout the 2021 calendar year. We will leverage 1st party solutions for customer feedback. Learn more here.

Data Factory

Azure Data Factory allows you to manage the production of trusted information by offering an easy way to create, orchestrate, and monitor data pipelines over the Hadoop ecosystem using structured, semi-structures and unstructured data sources. You can connect to your on-premises SQL Server, Azure database, tables or blobs and create data pipelines that will process the data with Hive and Pig scripting, or custom C# processing. The service offers a holistic monitoring and management experience over these pipelines, including a view of their data production and data lineage down to the source systems. The outcome of Data Factory is the transformation of raw data assets into trusted information that can be shared broadly with BI and analytics tools.

Do you have an idea, suggestion or feedback based on your experience with Azure Data Factory? We’d love to hear your thoughts.

  1. Unable to connect to SAP RFC to extract the data using SAP table connector in Azure Data Factory

    Unable to connect to SAP RFC to extract the data using SAP table connector in Azure Data Factory

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Intellisense support for dynamic content

    Right now there is no intelli-sense support for dynamic content. It would be a great addition to have in the dynamic content.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Load integration runtimes from github

    When we have the source code of a data factory in github and we create a new data factory in azure linked to this existing github repository, although it bring to us all the previous integration runtime, they will not be working.

    Any custom runtime on the data factory will not be working until we delete them and create again.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. Azure Data factory Partition option DynamicRange failing when no rows from source to copy

    Hi

    For copy activity when Partition option DynamicRange used with Polybase ,when no rows/data to load to Synapse with above config the copy activity is failing .

    The error reported is
    ErrorCode=UserErrorSourceBlobNotExist,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The required Blob is missing

    Can this be fixed from MS side.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. .dbf File Type Support

    Support for either:
    1. the ability to open .dbf files as .csv files (similar to how Excel can) as there currently is an error that is thrown when trying to do this
    2. the ability to choose .dbf as a dataset format when creating a new dataset

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Specify the filename of the txt file inside the zip folder on Copy

    Copy and compressed the data from Oracle to File System, How to specify the filename in Zipped folder?

    Is it possible to do with single copy activity instead of creating two copy activity?

    for. e.g file name should be abc.txt Instead of data_1dhgghudhf4545.txt

    #copy #compress #sink #zip #filename #Data_GUID

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. Job pipeline Export button should be there.

    If I need to Export the Job details then I have to do it manually, there is no option to Export.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Query Activity

    The Query Activity should allow the user to paste or type a query into a text editor. This editor will highlight keywords as SQL editors normally do.

    Then, the developer can assign the query to an existent variable (or create the variable initialized with the query.

    Currently, queries can only being pasted into a variable of type textbox. This means, we need to ensure that any comment in the query its removed which is annoying.

    Also, if we wish to do modifications its annoying because we need to keep a separated file to do so. Retrieving the query from the…

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  9. ADF copy data activity with dynamic source databaset.

    ADF currently supports the various fields including dynamic mapping and as dynamic content in copy data activity.
    Looking for the support of Source Dataset field also as an dynamic content. So the source can also be decided during runtime /execution.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Change Arrow direction in Import ARM template

    under ARM template option in ADF, Import ARM template the arrow should be pointing in left direction but not right. Export antonym Import, so should be the arrow

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  11. Ability to have an Alert setup for a Pipeline that is running too long or hung up for some reason

    We have been having issues were a pipeline that we currently have setup keeps running. The job in question normally takes between 14 and 16 minutes to complete. However every once in awhile it just keeps running and never seems to finish. So far the longest it has gone with no one noticing it, on the IT team, has been ~20 hours and it was not until an end user of the data noticed that it was not updated that we were able to go in and fix the issue. Being that it was still running there was no failure,…

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Managed Identity for HDInsight Activities

    Now, the Azure HDInsight activity only supports authentication that uses Azure Blob storage account keys.

    It would be great to have a feature to support Managed Identity for HDInsight activities to make things easier.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. FTP as a Sink

    Hi,
    Please add the ability to use FTP as a sink.
    Today FTP is only available as a source where SFTP is available as source and sink.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Ability to filter Output section of a debug run pipeline

    I created a pipeline that uses a foreach to process over 1100 commands. Looking at the output, I have to scroll through each page individually (at 100 at a time) to find the activities that errored out. Would be nice to be able to filter out the successful activities and review only the errors. Actually, expand that to any filtering for items shown in Debug output.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Switch User

    There doesn't seem to be a way to switch the current user of ADF UI like there is on the main Azure portal.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. UTF-8 encoding options in ADF datasets

    Enable users to re-encode dataset content and convert from UTF-8 NO BOM to plain UTF-8. Currently the only way to do this is download the file, manually convert the document encoding in Notepad++ and upload it.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Currently Publishing Individual Pipeline/DataFlow not possible


    1. We have opened and doing development for Multiple Pipeline, I wanted to publish only one pipeline using Publish, But its not supported and only publish all options only.

    2. Saving Draft options not available.

    3. There is no Desktop version available for ADF as like Power BI. This is quite complex while working online mode.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. ADF data source support for Hyperion source\sink

    Is there any plan to have Hyperion as data source or sink for data factory in upcoming releases?

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Ability to modify the connectivity time-out in Integration Runtime

    Need the functionality to be able to modify Connectivity time-out of 15 secs in Integration Runtime. When 5 ODBC connections are made to an external source at the same time, one connection fails due to time-out of 15 sec. If Connectivity time-out in IR can be changed, this can be resolved.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Support Loading of ContentNote for Salesforce

    Copy Activity doesn't support Loading of ContentNote for Salesforce. There should be a mapping to a physical file location. We had to build a custom C# App to do this

    https://help.salesforce.com/articleView?id=000339316&type=1&mode=1

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Data Factory

Categories

Feedback and Knowledge Base