Provide a Unified Cluster Experience for HDInsight
Instead of HDInsight seperating the core functionality into disparate packages, provide the ability to run multiple roles on the same cluster.
This would enable multi-step processing use cases to be performed using a single cluster (instead of multiple).
For example: Kafka Stream -> Spark -> HBase
In the current topology, this scenario requires 3 clusters which is expensive and complicated.