Azure Synapse Analytics
-
[In preview] PolyBase: allow escaping string delimiters within string fields
This feedback item is currently in preview here:
https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest
If you want to quote the string columns, and if one of the quoted columns has a quote character in it, the proper way to encode this is to double the quote character. (Build a CSV file in Excel and you will see that's how it saves it. I would say Excel is the authority on CSV formats.)
it appears it's impossible for Polybase to properly load that file. For example the following format is not interpreted right with STRING_DELIMITER = '"' since it divides the value 2.5" into two columns
…
253 votes -
[In preview] Polybase: allow field/row terminators within string fields
This feedback item is currently in preview here:
https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest
If a line end is present within a text field (qualified) importing data using Polybase will fail.
Loading this line will work fine:
1;2.1;"zzzz"Loading this will fail:
1;2.1;"zz
zz"Code:
CREATE EXTERNAL FILE FORMAT textfileformat_raw
WITH
(FORMAT_TYPE = DELIMITEDTEXT,
FORMAT_OPTIONS
(
FIELD_TERMINATOR =';',
STRING_DELIMITER = '0x22',
USE_TYPE_DEFAULT = TRUE
));
CREATE EXTERNAL TABLE dbo.testexternal
(
col1 INT,
col2 DECIMAL(2,1),
col3 NVARCHAR(5)
)
WITH
(
LOCATION = 'testfailing.txt',
DATASOURCE = azurestorage,
FILEFORMAT = textfileformatraw
);CREATE TABLE dbo.test
WITH…236 votes -
[In preview] Load a subset of data - currently you can either point to a source file or a source folder
This feedback item is currently in preview here:
https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest
A few ways this can be done: defining a regular expression or wild card support
58 votes -
[In preview] Import files via single COPY command from blob store.
This feedback item is currently in preview here:
https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest
It shouldn't require 5+ unintelligible queries just to import a file from blob store. Redshift lets me import files (including zipped files) from S3 with a single COPY command.
44 votes
- Don't see your idea?