Apache Spark 3.0 is now available for public preview in HDInsight 4.0.
Apache Spark 3.0 public preview in HDInsight 4.0 is a major update to Apache Spark and brings significant improvements including better performance and better support for ANSI SQL.
Source: Microsoft Azure – aggiornamenti