Support SNAPPY compression and decompression
SNAPPY is a fast compressor/decompressor from Google. See GitHub - google/snappy: A fast compressor/decompressor. SNAPPY is widely used for all Hadoop based big data projects. My customers need it. Please add ability for ADLA (U-SQL) to extract/read SNAPPY compressed files (Parquet/ORC) and ability to write/output SNAPPY compressed files (Parquet/ORC). Thanks in advance.
4
votes
Subhransu Sahoo
shared this idea
1 comment
-
Michael Rys
commented
Parquet support with snappy is now in public preview. See https://github.com/Azure/AzureDataLake/blob/master/docs/Release_Notes/2018/2018_Spring/USQL_Release_Notes_2018_Spring.md#built-in-parquet-extractor-and-outputter-is-in-public-preview
ORC support is in private preview.
Are there other places you need SNAPPY support?