How can we improve Microsoft Azure Data Lake?

Provide a way for the EXTRACT statement to source the records rejected by the "-silent" option

It would be very useful to allow the EXTRACT statement source rejected records in some way. For instance, when records are rejected by using the "-silent" option in DefaultTextExtractor, it would be useful to shunt those records to a rejected output file. "WITH REJECTED RECORDS AS @mybadrecordrowset" (or similar) as an option on the EXTRACT statement would be pretty awesome to have.

38 votes
Sign in
(thinking…)
Password icon
Signed in as (Sign out)

We’ll send you updates on this idea

Anonymous shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

2 comments

Sign in
(thinking…)
Password icon
Signed in as (Sign out)
Submitting...
  • Monica Huerta commented  ·   ·  Flag as inappropriate

    Hi, is there any update on this?
    When we are using the silent:true option, it would be really helpful to log the rows skipped due to invalid number of columns.

  • Frank commented  ·   ·  Flag as inappropriate

    Any update on this? For those of us using dynamic schemas in ADFv2 this would be huge!

Feedback and Knowledge Base