Update: Microsoft will be moving away from UserVoice sites on a product-by-product basis throughout the 2021 calendar year. We will leverage 1st party solutions for customer feedback. Learn more here.

Data Factory

Azure Data Factory allows you to manage the production of trusted information by offering an easy way to create, orchestrate, and monitor data pipelines over the Hadoop ecosystem using structured, semi-structures and unstructured data sources. You can connect to your on-premises SQL Server, Azure database, tables or blobs and create data pipelines that will process the data with Hive and Pig scripting, or custom C# processing. The service offers a holistic monitoring and management experience over these pipelines, including a view of their data production and data lineage down to the source systems. The outcome of Data Factory is the transformation of raw data assets into trusted information that can be shared broadly with BI and analytics tools.

Do you have an idea, suggestion or feedback based on your experience with Azure Data Factory? We’d love to hear your thoughts.

  1. Expand Pipeline Activity For Contained Items

    I would like the ability to expand a pipeline activity for the activities within that pipeline. This would allow for easily copying an existing pipeline into a new one without having to copy activities individually. It would improve the speed for creating loops around existing pipelines.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. need indexOf(pattern) support and replace(fromIndex, toIndex) support

    Sometimes we need to find and replace/remove pieces of string from certain index. It's a core function to most of the languages. Would be awesome to get support for this function in the expressions builder

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Raiserror in Stored procedure

    If I could handled RAISERROR into SP in ADF SP activity without stopping the pipeline

    if (Raiserror condition in SP) then unsuccesfully continue do "next errorhandler activity"

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. Make Azure Datafactory more user friendly

    Make Azure Data Factory more user friendly.


    • Unable to order the pipeline status - If i want to select failed pipe lines, i have to go to filter and select that, instead of this, if we are able to order the status and other columns from the header, it would be better.


    • Filter Time range, Instead of selecting radio button, please enable the whole line as SELECTOR


    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. Always Visible Annotation Text-boxes in Dataflow for group of transformations

    As data flow becomes complex with lot of transformations it required for us to provide a summary text against group of transformations and their functionality . Example first set of transformation is to build parent data-set and second set of transformation is to attach parent data to child dataset , placing simple text boxes similar to how we have in power-point will give us summary of each block of transformation with in Dataflow , Right now Annotation for each transformation needs to be individually inspected to understand whole dataflow

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. trigger next run time

    Add the next run time to the triggers view. Particularly when updating code, pushing new... the calcs that are done when the start time is in the past and how it calculates the next occurrence, it would be nice if the trigger screen (or the trigger run screen) included the next run date/time.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. powerbi

    Able to connect and import PowerBI datasets in workspace.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. powerbi

    Able to refresh PowerBI datasets in workspace.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  9. powerbi

    Able to send an email from Azure Data Factory informing the status of a pipeline task (e.g. Success or failure)

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Manually Execute a Trigger

    Ability to manually execute a trigger.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. Add Auto/Default to Copy Activity's "Degree of copy parallelism" field

    The documentation says: "The default behavior of parallel copy usually gives you the best throughput, which is auto-determined by ADF based on your source-sink pair, data pattern and number of DIUs or the Self-hosted IR's CPU/memory/node count. Refer to Troubleshoot copy activity performance on when to tune parallel copy."

    The default setting for "Degree of copy parallelism" is a blank field with the "Edit" button checked. This is confusing when compared with the "Data integration unit" field directly above, for which "Auto" is the default option.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Allow to SetUp a trigger based on new event(create/delete file) in a File Share

    It will be great to have the capability to trigger a Pipeline in the ADF based on events in the ADF like currently do it with blob storages

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. Provide description field for parameters and variables.

    It is very common to have a number of parameters and variables for an ADF pipe. It is a problem remembering what these parameters mean and allowable values. It would be very helpful to have a description field to document these parameters and variables.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Show Local/Fuso DateTime on Pipeline runs

    Implements the option to show Local DateTime Fuso.
    For exemple, We have a time on Storage Account and a different fuso on Data Factory.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Fix the support for Excel (Large Files > 45MB).

    Pipeline(run) crashes when reading Excel files larger than 45MB.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. PowerShell commnad or API to publish pipelines

    I couldn't found any method to publish pipeline changes to a collaboration branch except the Azure portal.

    If we have that one, could you please provide us the documentation? If not please consider this as a request and implement it for automation.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. 1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. 1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Debug Run only certain blocks (including Lineage)

    Debug Run of a pipeline but only for a specific lineage or selected blocks. To help debug large complicated overlapping pipelines, it would be useful to be able to select show lineage first. Then click debug to run a debug session only for the selected blocks based on the lineage. This way the entire pipeline doesn't need to be run during debug.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Snowflake connector support for both Azure and AWS instances

    Provide support to use the Snowflake connector to access both AWS and Azure instances of snowflake.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Data Factory

Categories

Feedback and Knowledge Base