Add support for compressed output
I have historic data imported through spark in avro format to our Gen 1 Data Lake. I am now using ASA to stream the live data.
Spark defaults to uses snappy to compress avro files where as ASA doesn't compress. This has resulted in a 10 fold increase in storage size and a slow down in access speed. Can you add support for compression of the outputs in ASA?