You can now use Apache Spark 2.3.0, Apache HBase 1.4.2, and Presto 0.194 on Amazon EMR release 5.13.0. Spark 2.3.0 adds several new features and updates, including continuous processing mode in Structured Streaming for lower end-to-end latency, an improved ORC file format reader that supports vectorized reads and improves scan throughput, PySpark and Pandas interoperability improvements. improvements. HBase 1.4.2 and Presto 0.194 includes various bug fixes and improvements. Additionally, the AWS SDK included on your Amazon EMR clusters is now updated to 1.11.297.
Advertisements
