Update the version of HDInsight
Azure Data Factory latest version of HDInsight compute clusters is 3.2 and HDInsight is already in version 3.6. These new version bring newer version of OS (Ubuntu 12.04 to Ubuntu 16), and of course new version of the Hadoop ecosystem, namely Hive, Pig and Spark. Also, and not least important, HDInsight 3.2 is already deprecated by Microsoft (https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-component-versioning#supported-hdinsight-versions).
Keynes Yang commented
Thanks for the feedback. It's working in progress. Please see this notification. https://docs.microsoft.com/en-us/azure/data-factory/data-factory-compute-linked-services#supported-hdinsight-versions-in-azure-data-factory