Allow larger (>16MB) files in blob storage when using one to many indexers
When using a one to many indexer with files in Azure Blob Storage the indexer appears to still attempt to read the entire file at once. As a result files > 16MB fail to be indexed because they exceed the payload size limit.
Since its one to many the indexer should be able to read individual lines from the file and index them without reading the full file.
Additionally there is no helpful error message when this happens, it just appears as if the indexer never ran.