How can we improve Microsoft Azure Data Lake?

Provide a way for the EXTRACT statement to source the records rejected by the "-silent" option

It would be very useful to allow the EXTRACT statement source rejected records in some way. For instance, when records are rejected by using the "-silent" option in DefaultTextExtractor, it would be useful to shunt those records to a rejected output file. "WITH REJECTED RECORDS AS @mybadrecordrowset" (or similar) as an option on the EXTRACT statement would be pretty awesome to have.

38 votes
Sign in
(thinking…)
Sign in with: Microsoft
Signed in as (Sign out)

We’ll send you updates on this idea

Anonymous shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

2 comments

Sign in
(thinking…)
Sign in with: Microsoft
Signed in as (Sign out)
Submitting...
  • Monica Huerta commented  ·   ·  Flag as inappropriate

    Hi, is there any update on this?
    When we are using the silent:true option, it would be really helpful to log the rows skipped due to invalid number of columns.

  • Frank commented  ·   ·  Flag as inappropriate

    Any update on this? For those of us using dynamic schemas in ADFv2 this would be huge!

Feedback and Knowledge Base