How can we improve Microsoft Azure Data Lake?

support row delimiters in quoted data fields in the built-in extractors

support row delimiters in quoted data fields in the built-in extractors. This option will allow columns to parse properely when there are columns with quotation and it has new line inside. This was from my customer.

30 votes
Sign in
Check!
(thinking…)
Reset
or sign in with
    Password icon
    Signed in as (Sign out)

    We’ll send you updates on this idea

    Bala shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

    2 comments

    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
      Password icon
      Signed in as (Sign out)
      Submitting...
      • Naveen Kanneganti commented  ·   ·  Flag as inappropriate

        Its indeed a very basic requirement to support the escape/ quote character for the row delimiters.
        Strange to see that its not yet supported :(

      • Guillaume Rouchon commented  ·   ·  Flag as inappropriate

        This is an issue i ran into will trying to integrate Data Factory and Data Lake Analytics.

        There is no complete integration between the two as you cannot read with analytics out of the box a file generated from data factory (what ever the format) and be sure at a 100% that all files will pass. CSV and TSV have issue with row delimiters in value (i understand the reasoning behind the current implementation), there's no workaround (like escaping row delimiter?) and analytics doesn't support other file format out of the box.

        Currently i'm using the JsonExtractor from the sample and have to review all my data factory pipelines...

      Feedback and Knowledge Base