Spark Datasets released by Databricks, new Developer Community by Conviva, and survey shows lack of full DevOps adoption

Databricks has introduced Spark Datasets, an extension of the DataFrames API that provides a type-safe, object-oriented programming interface. Spark 1.6 includes an API preview of Datasets, and they will be a development focus for the next several versions of Spark.